-- Logs begin at Mon 2022-06-06 19:40:52 UTC, end at Mon 2022-06-06 21:01:01 UTC. -- Jun 06 20:33:15.797883 dv-cinder-844879-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 20:33:15.806305 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 20:33:15 2022] *** Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: nodename: dv-cinder-844879-1-iscsi Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: machine: x86_64 Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: clock source: unix Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: pcre jit disabled Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: detected number of CPU cores: 4 Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: current working directory: / Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: detected binary path: /usr/bin/uwsgi-core Jun 06 20:33:15.808301 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: your processes number limit is 47680 Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: your memory page size is 4096 bytes Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: detected max file descriptor number: 2048 Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: lock engine: pthread robust mutexes Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: thunder lock: enabled Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 20:33:15.809083 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 20:33:15.852900 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: Python main interpreter initialized at 0x5640609719c0 Jun 06 20:33:15.852900 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: python threads support enabled Jun 06 20:33:15.852900 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: your server socket listen backlog is limited to 100 connections Jun 06 20:33:15.852900 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: your mercy for graceful operations on workers is 90 seconds Jun 06 20:33:15.853227 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 20:33:15.853310 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: *** Operational MODE: preforking *** Jun 06 20:33:15.853576 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: *** uWSGI is running in multiple interpreter mode *** Jun 06 20:33:15.853576 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: spawned uWSGI master process (pid: 110178) Jun 06 20:33:15.853785 dv-cinder-844879-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 20:33:15.854439 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: spawned uWSGI worker 1 (pid: 110179, cores: 1) Jun 06 20:33:15.855362 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: spawned uWSGI worker 2 (pid: 110180, cores: 1) Jun 06 20:33:15.855362 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 20:33:17.066093 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:33:17.075432 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:33:17.777977 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:33:17.777977 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: from cryptography.utils import int_from_bytes Jun 06 20:33:17.778302 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:33:17.778302 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: from cryptography.utils import int_from_bytes Jun 06 20:33:17.778696 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:33:17.778696 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: from cryptography.utils import int_from_bytes Jun 06 20:33:17.779031 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:33:17.779031 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: from cryptography.utils import int_from_bytes Jun 06 20:33:20.318878 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:33:20.319414 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:33:20.319636 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:33:20.320016 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:33:20.320185 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:33:20.320574 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:33:20.320666 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:33:20.320747 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.320948 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.321052 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:33:20.321262 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.321359 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:33:20.321546 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:33:20.321644 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.321889 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.321983 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322195 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322289 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322510 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322596 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322822 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.322918 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323142 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323303 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323395 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323488 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323712 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.323806 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324033 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-1-iscsi {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324119 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324348 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324437 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324633 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324730 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.324941 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325026 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325251 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325339 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-1-iscsi {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325548 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325642 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325859 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.325944 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.326156 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.326243 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.326473 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.326644 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.326778 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328300 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328456 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328567 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328693 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328813 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.328932 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329079 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329213 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329338 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329450 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329578 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329713 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329839 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.329974 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330114 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330240 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330374 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330511 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330644 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330776 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.330901 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-1-iscsi {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331033 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331160 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331284 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331414 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331550 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331713 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.331842 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-1-iscsi {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332018 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332156 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332322 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332460 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332627 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332757 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.332941 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333130 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333263 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333441 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333581 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333750 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.333889 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334071 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334200 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334394 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334532 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334701 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.334844 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335025 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335160 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335327 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335463 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335629 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335803 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.335972 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336111 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336271 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336402 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336568 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336705 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336831 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.336955 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337100 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337229 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337415 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337546 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337728 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337864 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.337997 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338122 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338267 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338401 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338528 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338652 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338803 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.338947 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339118 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339249 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339413 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339551 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339698 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339844 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.339993 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340123 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340313 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340453 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340617 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340745 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.340914 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341041 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341212 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341349 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341511 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341642 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341813 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.341940 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342117 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342247 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342422 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342552 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342746 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.342884 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343058 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343206 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343368 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343503 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343716 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343850 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.343997 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344145 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344316 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344444 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344629 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344765 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.344930 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345077 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345236 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345364 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345548 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345676 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.345848 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346055 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346191 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346317 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346441 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346565 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346729 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.346861 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347044 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347174 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347341 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347470 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347606 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347788 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.347917 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348041 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348190 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348319 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348503 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348633 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348802 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.348931 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349100 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349227 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349396 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349532 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349690 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349819 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.349989 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350119 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350289 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350593 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350721 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.350890 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351026 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351186 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351321 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351483 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351612 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351807 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.351948 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352104 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352234 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352400 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352530 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352700 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.352836 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353004 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353134 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353300 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353427 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353596 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353734 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.353895 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354025 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354192 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354323 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354497 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354633 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354793 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.354927 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355090 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355222 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355389 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355526 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355705 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.355837 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356006 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356136 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356316 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356462 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356615 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356744 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.356913 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357042 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357213 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357355 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357505 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357632 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357804 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.357940 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.358103 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.358231 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.358933 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359060 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359233 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359361 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359527 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359655 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359860 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.359999 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360156 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360297 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360457 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360587 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360750 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.360878 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361047 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361174 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361338 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361474 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361635 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361776 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.361933 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362073 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362233 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362369 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362529 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362658 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362824 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.362960 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.363134 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.363264 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.363436 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.363563 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.363761 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.363903 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.364064 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.364194 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.364379 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:33:20.364509 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.364708 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.364851 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365038 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365166 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365350 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365485 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365660 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365798 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.365971 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366101 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366295 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366424 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366602 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366732 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.366911 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367040 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367220 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367354 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367532 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367732 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367863 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.367998 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368164 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368303 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368475 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368692 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368830 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.368957 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369082 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369206 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369376 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369507 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369687 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369816 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.369999 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370125 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370313 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370481 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370622 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370749 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.370957 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371096 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371298 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371435 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371608 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371759 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.371952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372095 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372269 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372398 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372575 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372713 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.372879 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373021 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373182 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373312 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373498 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373635 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.373825 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.374568 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.374706 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.374833 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.374995 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375125 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375305 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375435 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375614 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375789 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.375947 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376078 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376256 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376380 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376563 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376694 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.376877 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377014 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377189 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377497 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377625 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377804 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.377943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378115 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378245 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378422 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378564 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378729 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.378867 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379034 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379164 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379334 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379472 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379633 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379803 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.379958 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380089 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380263 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380394 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380565 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380871 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.380993 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381176 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381314 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381476 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381613 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381777 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.381913 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382090 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382218 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382396 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382528 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382704 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.382831 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383006 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383142 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383306 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383437 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383612 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383802 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.383928 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384053 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384228 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384370 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384531 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384667 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384838 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.384965 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385139 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385262 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385441 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385588 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385744 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.385886 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386044 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386182 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386353 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386493 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386662 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386806 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.386953 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387083 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387253 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387390 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387555 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387721 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.387892 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388020 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388200 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388337 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388506 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388643 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388817 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.388955 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389140 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389270 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389438 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389574 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389778 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.389937 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390112 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390242 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390425 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390555 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390734 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.390861 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391059 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391188 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391383 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391513 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391720 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.391866 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392025 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392163 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392328 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392467 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392627 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392757 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.392927 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393071 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393227 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393357 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393526 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393663 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393823 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.393961 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394125 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394253 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394429 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394566 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394725 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.394861 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395023 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395153 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395452 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395632 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395859 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.395989 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396114 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396240 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396364 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396539 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396679 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.396880 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397010 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397183 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397322 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397497 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397626 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397807 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.397944 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398112 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398243 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398419 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398557 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398723 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.398851 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399027 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399160 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399336 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399464 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399639 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399798 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.399970 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400099 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400273 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400402 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400588 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400714 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.400889 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401026 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401202 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401338 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401501 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401631 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401821 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.401957 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.402129 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.402285 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.402702 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.402874 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403010 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403185 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403323 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403502 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403632 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.403900 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404032 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404214 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404353 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404501 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404663 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404811 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.404949 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405134 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405264 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405444 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405582 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405758 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.405896 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406063 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406193 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406374 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406505 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406679 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406821 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.406995 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407123 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407297 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407425 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407607 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407804 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.407933 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408064 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408228 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408358 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408552 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408690 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408854 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.408990 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409169 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409298 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409475 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409610 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409790 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.409920 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410096 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410229 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410405 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410541 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410710 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.410839 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411013 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411150 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411316 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411454 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411623 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411774 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.411952 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412092 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412257 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412395 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412565 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412692 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.412870 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413009 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413176 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413303 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413482 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413609 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413784 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.413924 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414081 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414209 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414386 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414516 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414690 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414831 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.414996 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415126 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415307 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415436 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415621 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415804 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.415933 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416059 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416232 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416371 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416548 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416678 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416852 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.416982 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417152 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417282 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417452 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417583 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417751 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.417888 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418053 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418182 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418357 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418486 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418660 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418796 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.418970 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419097 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419285 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419422 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419586 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419732 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.419924 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.420064 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.420229 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.420360 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.420540 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.420682 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.421371 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.421508 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.421681 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.421815 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.421986 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422115 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422292 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422431 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422598 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422728 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.422903 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423039 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423206 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423342 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423514 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423641 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423843 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.423979 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424149 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424289 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424587 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424754 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.424897 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425097 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425225 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425358 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425483 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425645 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.425907 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426048 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426239 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426369 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426553 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426810 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.426939 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427146 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427277 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427465 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427604 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427811 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.427959 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428134 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428264 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428454 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428583 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428757 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.428895 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429064 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429366 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429503 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429666 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429810 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.429972 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430102 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430272 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430411 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430571 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430701 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.430874 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431018 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431177 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431307 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431475 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431604 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431784 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.431925 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432083 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432221 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432381 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432511 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432684 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432826 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.432966 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433100 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433270 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433407 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433567 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433711 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.433881 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434184 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434312 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434482 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434621 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434779 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.434909 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435076 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435237 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435411 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435550 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435731 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.435863 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.436064 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.436206 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.436995 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437143 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437342 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437472 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437645 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437775 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.437946 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438091 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438266 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438396 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438565 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438695 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438864 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.438994 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439162 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439293 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439467 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439597 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439796 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.439928 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440098 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440229 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440403 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440532 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440707 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.440838 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441017 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441146 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441320 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441450 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441617 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441748 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.441920 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442050 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442219 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442363 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442525 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442655 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442830 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.442966 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443126 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443269 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443423 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443553 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443748 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.443880 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444051 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444201 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444337 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444473 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444637 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444767 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.444930 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445074 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445238 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445368 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445535 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445665 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445833 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.445964 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446128 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446257 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446430 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446560 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446731 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.446861 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447026 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447156 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447332 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447460 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447634 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447794 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.447966 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448095 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448261 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448389 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448562 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448694 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448857 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.448987 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449153 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449360 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449489 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449616 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449747 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.449872 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450045 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450189 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450341 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450470 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450643 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450782 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.450945 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451084 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451242 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451379 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451538 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451698 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.451866 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452024 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452189 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452319 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452486 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452617 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452783 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.452913 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453079 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453208 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453374 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453511 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453674 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453805 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.453975 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454105 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454270 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454398 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454567 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454697 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454863 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.454997 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455177 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455306 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455479 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455610 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455806 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.455937 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456107 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456250 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456435 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456562 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456739 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.456878 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457041 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457183 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457345 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457487 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457651 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457781 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.457950 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458090 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458258 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458389 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458561 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458690 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.458866 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459005 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459164 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459294 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459458 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459587 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459792 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.459933 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460094 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460230 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460392 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460520 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460695 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.460826 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461013 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461145 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461322 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461459 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461617 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461747 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.461917 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462047 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462217 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462348 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462518 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462648 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462820 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.462951 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463123 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463254 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463426 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463555 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463739 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.463867 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464047 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464187 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464351 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464479 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464655 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464794 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.464955 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465094 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465260 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465390 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465560 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465688 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465859 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.465998 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466162 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466298 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466468 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466596 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466768 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.466908 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467071 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467201 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467368 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467499 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467739 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.467874 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468043 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468173 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468348 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468490 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468655 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468795 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.468964 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469095 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469268 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469397 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469617 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469753 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.469921 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470050 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470229 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470359 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470536 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470667 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470837 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.470968 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471156 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471293 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471471 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471601 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471807 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.471930 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472112 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472254 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472448 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472576 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472747 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.472886 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473051 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473194 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473369 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473498 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473669 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473800 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.473970 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474109 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474269 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474400 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474586 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474716 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.474886 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475016 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475187 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475491 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475621 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475836 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.475968 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.476141 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.476271 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.476462 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.476600 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.476877 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477012 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477179 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477323 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477484 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477611 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477814 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.477943 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478105 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478234 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478449 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478597 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478732 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478858 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.478993 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479140 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479311 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479442 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479631 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479804 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.479973 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480104 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480284 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480415 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480584 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480727 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.480901 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481033 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481221 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481353 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481532 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481676 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481835 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.481970 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482288 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482479 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482622 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482792 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.482921 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.483113 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.483803 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484082 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484222 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484392 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484524 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484698 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.484836 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485009 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485141 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485313 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485445 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485615 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485760 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.485929 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486085 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486212 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486338 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486501 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486639 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486803 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.486941 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487112 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487241 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487415 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487554 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487736 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.487867 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488052 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488192 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488352 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488555 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488692 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488824 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.488951 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489076 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489252 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489384 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489556 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489686 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.489891 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490031 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490166 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490300 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490477 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490607 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490780 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.490911 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491080 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491211 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491379 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491509 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491711 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.491843 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492019 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492143 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492322 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492451 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492625 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492755 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.492967 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493098 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493272 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493401 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493593 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493731 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.493920 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494050 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494245 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494375 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494554 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494693 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.494871 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495000 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495171 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495315 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495471 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495611 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495798 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.495929 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496098 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496229 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496399 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496543 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496699 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.496832 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497004 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497134 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497302 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497440 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497601 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497733 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.497899 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498030 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498204 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498333 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498499 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498635 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498800 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.498961 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.499668 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.499812 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500003 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500133 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500308 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500445 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500630 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500774 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.500940 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501070 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501243 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501383 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501547 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501676 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501850 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.501980 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502193 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502331 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502498 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502627 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502830 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.502959 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503143 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503285 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503455 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503585 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503790 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.503932 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504098 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504236 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504404 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504533 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504715 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.504889 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505017 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505153 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505313 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505443 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505616 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505754 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.505926 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506055 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506230 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506359 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506539 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506669 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.506843 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507054 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507185 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507378 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507515 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507712 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.507863 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508025 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508290 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508423 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508620 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508750 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.508927 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509056 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509235 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509366 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509543 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509679 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509850 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.509980 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510160 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510295 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510473 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510612 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510785 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.510915 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511095 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511223 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511407 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511551 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511750 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.511881 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512062 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512191 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512372 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512503 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512682 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.512812 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513012 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513140 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513328 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513458 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513629 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513757 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.513937 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514082 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514249 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514379 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514616 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514753 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.514955 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515097 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515273 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515404 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515591 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515739 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.515935 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516065 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516239 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516367 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516547 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516674 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516855 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.516984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517163 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517299 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517472 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517599 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517802 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.517933 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518087 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518216 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518394 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518530 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518704 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.518834 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519014 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519142 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519341 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519531 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519697 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519871 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.519999 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.520200 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.520340 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.520521 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.520787 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.520923 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521103 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521230 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521437 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521577 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521761 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.521895 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522063 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522191 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522363 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522491 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522668 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522805 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.522972 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523101 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523271 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523400 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523586 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523743 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.523918 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524047 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524218 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524354 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524519 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524653 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524822 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.524949 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.525136 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.525353 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.525490 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.525696 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.525823 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526013 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526143 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526338 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526560 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526682 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.526905 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.527042 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.527223 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.527353 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.527832 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.527961 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528136 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528277 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528441 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528569 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528756 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.528882 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529064 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529197 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529367 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529503 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529671 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529805 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.529979 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530129 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530313 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530442 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530616 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530750 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.530921 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531057 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531219 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531352 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531530 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531650 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531860 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.531990 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532162 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532290 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532464 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532600 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532770 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.532896 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533072 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533199 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533374 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533518 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533677 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533803 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.533975 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534101 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534276 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534411 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534574 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534701 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.534877 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535003 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535176 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535312 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535483 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535620 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535809 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.535936 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536101 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536243 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536404 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536531 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536714 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.536842 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537020 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537156 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537334 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537463 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537642 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537778 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.537947 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538076 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538265 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538392 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538575 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538703 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.538881 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539010 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539191 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539318 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539514 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539656 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.539859 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540064 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540193 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540394 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540521 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540709 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.540839 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541037 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541326 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541454 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541658 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541798 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.541959 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542088 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542258 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542386 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542578 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542715 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.542885 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543014 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543190 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543317 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543493 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543630 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543822 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.543951 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544128 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544259 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544434 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544566 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544740 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.544871 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.545043 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.545175 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.545349 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.545485 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.545651 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.546306 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.546490 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.546630 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.546793 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.546915 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547098 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547238 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547406 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547612 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547774 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.547903 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548036 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548163 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548338 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548478 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548655 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548793 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.548964 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549093 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549269 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549413 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549574 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549704 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.549878 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550009 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550182 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550321 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550491 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550619 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550800 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.550930 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551106 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551244 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551410 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551539 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551745 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.551878 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552076 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552216 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552390 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552528 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552695 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.552834 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553037 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553173 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553355 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553488 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553674 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553815 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.553981 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554113 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554297 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554427 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554602 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554742 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.554925 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555056 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555234 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555372 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555555 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555708 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.555890 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556035 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556192 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556328 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556493 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556625 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556795 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.556925 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557100 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557230 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557411 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557543 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557716 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.557846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558015 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558154 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558314 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558452 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558619 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558758 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.558917 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559057 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559217 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559348 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559517 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559699 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559830 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.559968 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560130 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560269 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560428 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560566 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560725 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.560866 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.561023 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.561161 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.561321 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.561997 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562138 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562330 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562461 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562635 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562765 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.562941 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563080 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563243 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563374 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563544 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563698 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.563909 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564056 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564214 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564345 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564517 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564647 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564817 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.564958 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565121 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565251 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565424 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565555 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565755 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.565886 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566084 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566213 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566398 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566526 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566700 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.566840 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567017 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567148 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567338 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567475 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567646 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567813 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.567975 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568106 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568298 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568435 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568603 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568734 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.568910 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569040 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569219 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569365 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569527 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569657 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569834 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.569962 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570140 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570270 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570449 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570578 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570759 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.570889 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571059 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571197 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571380 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571510 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571712 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.571858 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572020 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572149 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572336 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572465 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572642 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572780 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.572961 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573103 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573265 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573394 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573569 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573700 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.573879 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574010 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574182 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574313 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574488 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574625 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574795 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.574932 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575101 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575231 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575412 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575552 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575750 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.575883 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576057 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576186 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576378 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576587 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576716 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.576840 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577015 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577148 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577347 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577490 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577672 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577808 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.577999 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578128 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578309 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578441 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578618 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578748 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.578921 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.579051 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.579185 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:33:20.579319 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.579561 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.579890 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:33:20.580132 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:33:20.638000 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO dbcounter [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Registered counter for database nova_api Jun 06 20:33:20.639047 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Registered counter for database nova_api Jun 06 20:33:20.658526 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.659980 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_db.sqlalchemy.engines [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.665149 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.666603 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writer thread running {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.722653 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.context [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d772098-9589-43ac-94cf-689c77728b5a(cell1) {{(pid=110179) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:33:20.722826 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.context [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d772098-9589-43ac-94cf-689c77728b5a(cell1) {{(pid=110180) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:33:20.726790 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:33:20.726917 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:33:20.728377 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:33:20.728544 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:33:20.729155 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:33:20.729270 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:33:20.731109 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:33:20.731216 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:33:20.733104 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO dbcounter [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Registered counter for database nova_cell0 Jun 06 20:33:20.733216 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Registered counter for database nova_cell0 Jun 06 20:33:20.737529 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO dbcounter [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Registered counter for database nova_cell1 Jun 06 20:33:20.737637 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Registered counter for database nova_cell1 Jun 06 20:33:20.745171 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_db.sqlalchemy.engines [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.747457 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.749620 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.750486 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writer thread running {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.751128 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_db.sqlalchemy.engines [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.756336 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.757662 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.891567 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writer thread running {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.900051 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO dbcounter [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Registered counter for database nova_cell0 Jun 06 20:33:20.900502 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Registered counter for database nova_cell0 Jun 06 20:33:20.909607 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_db.sqlalchemy.engines [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.913178 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:33:20.914042 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writer thread running {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:20.917544 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:33:21.450008 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: WARNING keystonemiddleware.auth_token [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:33:21.457340 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: WARNING keystonemiddleware.auth_token [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:33:21.464818 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:33:21.472128 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:33:21.681994 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: WARNING keystonemiddleware.auth_token [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:33:21.688528 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: WARNING keystonemiddleware.auth_token [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:33:21.693756 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640609719c0 pid: 110180 (default app) Jun 06 20:33:21.696840 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:33:21.696942 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:33:21.698055 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002791 Jun 06 20:33:21.698449 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Mon Jun 6 20:33:21 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:33:21.703244 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-2980da65-6f28-43aa-bc1b-787372da0e21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:33:21.708145 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640609719c0 pid: 110179 (default app) Jun 06 20:34:42.306152 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:42.307161 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 06 20:34:42.307543 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:42.321004 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:42.321814 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell0:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:42.322643 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell1:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:42.323908 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:42.762451 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-92dc9f49-d5f0-46c8-923d-a13e18001844 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:42.792341 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-92dc9f49-d5f0-46c8-923d-a13e18001844 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476434 Jun 06 20:34:42.793043 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 20:34:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:45.069341 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:45.070866 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-f624ebcb-6668-4508-805f-b4191699f130 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jun 06 20:34:45.071253 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:45.129968 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-a1523bc7-4da1-4e67-9f30-3bede85dbb0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:45.147503 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:34:45.147503 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Jun 06 20:34:45.250552 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-a1523bc7-4da1-4e67-9f30-3bede85dbb0c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.172864 Jun 06 20:34:45.251323 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:34:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:34:45.264527 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_api:SELECT=3 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:45.265365 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_cell0:SELECT=3 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:45.266294 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_cell1:SELECT=3 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:45.267062 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:34:45.476815 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-0c6d514f-3f8c-45bc-9c2c-2101c483e927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:45.479236 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:34:45.479236 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:34:45.636081 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-0c6d514f-3f8c-45bc-9c2c-2101c483e927 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.376609 Jun 06 20:34:45.636666 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 20:34:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:47.933890 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-a1523bc7-4da1-4e67-9f30-3bede85dbb0c admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:47.935494 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-a1523bc7-4da1-4e67-9f30-3bede85dbb0c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Jun 06 20:34:47.936045 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:48.038061 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-2ce4a8db-89d4-4b71-be34-76a20411cf5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:48.055363 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:34:48.055363 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:34:48.141922 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-2ce4a8db-89d4-4b71-be34-76a20411cf5c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.199805 Jun 06 20:34:48.142419 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:34:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:34:48.155046 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-508e655d-5cc0-4a51-969c-3fc5553714f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:48.156556 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:34:48.156556 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Jun 06 20:34:48.250278 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-508e655d-5cc0-4a51-969c-3fc5553714f8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099478 Jun 06 20:34:48.251162 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 20:34:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:51.162028 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-2ce4a8db-89d4-4b71-be34-76a20411cf5c admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:51.163406 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-2ce4a8db-89d4-4b71-be34-76a20411cf5c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jun 06 20:34:51.164208 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:51.224446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-745eeb9d-6d46-4121-bb40-5e947aae2529 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "vcpus": 1, "swap": 0, "disk": 10}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:51.320443 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-745eeb9d-6d46-4121-bb40-5e947aae2529 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150461 Jun 06 20:34:51.321322 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:34:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:34:51.333906 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-da0ea7bf-ae1d-4347-b97f-f3c798e89fd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:51.414833 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-da0ea7bf-ae1d-4347-b97f-f3c798e89fd3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084563 Jun 06 20:34:51.416160 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 20:34:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:53.740355 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-745eeb9d-6d46-4121-bb40-5e947aae2529 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:53.741369 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-745eeb9d-6d46-4121-bb40-5e947aae2529 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 06 20:34:53.741771 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:53.801780 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-466b3cc4-0647-4170-b9dc-ad09b548bbdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:53.889649 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-466b3cc4-0647-4170-b9dc-ad09b548bbdb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141274 Jun 06 20:34:53.890215 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:34:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:34:53.902275 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-b6de76b5-c60d-4817-ac48-a338dcd8974b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:53.967931 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-b6de76b5-c60d-4817-ac48-a338dcd8974b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069552 Jun 06 20:34:53.968517 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 20:34:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:56.260010 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-466b3cc4-0647-4170-b9dc-ad09b548bbdb admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:56.261537 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-466b3cc4-0647-4170-b9dc-ad09b548bbdb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jun 06 20:34:56.261932 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:56.321188 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "vcpus": 4}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:56.397340 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.129216 Jun 06 20:34:56.397883 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:34:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:34:56.410025 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3ce5983a-45da-4712-abcf-9ef08b067f34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:34:56.489371 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3ce5983a-45da-4712-abcf-9ef08b067f34 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082988 Jun 06 20:34:56.490075 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 20:34:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:34:58.765542 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:58.766783 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jun 06 20:34:58.767184 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:34:58.828814 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-c1ada0e7-8834-4c6f-b52a-2cdc38e7a8cc admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:34:58.852416 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-c1ada0e7-8834-4c6f-b52a-2cdc38e7a8cc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078926 Jun 06 20:34:58.853063 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 20:34:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:35:01.350867 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:01.352195 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c88e6b40-6631-4382-99b8-65e47e8503fd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Jun 06 20:35:01.352741 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:01.417324 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-ff0340d0-4af5-49ca-a6b7-45f123c4abed admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:01.536842 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-ff0340d0-4af5-49ca-a6b7-45f123c4abed admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.177614 Jun 06 20:35:01.537411 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:35:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:01.551319 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-158f56cc-d724-4fb1-ba24-73641b99fad9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:01.636379 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-158f56cc-d724-4fb1-ba24-73641b99fad9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088974 Jun 06 20:35:01.636997 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 20:35:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:35:03.945752 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-ff0340d0-4af5-49ca-a6b7-45f123c4abed admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:03.946749 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-ff0340d0-4af5-49ca-a6b7-45f123c4abed admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 06 20:35:03.947148 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:04.014593 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-03b5523c-3101-437d-be93-1a04f86a7b09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 2048}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:04.089350 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-03b5523c-3101-437d-be93-1a04f86a7b09 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136374 Jun 06 20:35:04.089829 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:35:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:04.103749 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-57b4d9b3-191a-45c5-bfe7-5fe9aaa8ef52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:04.191461 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-57b4d9b3-191a-45c5-bfe7-5fe9aaa8ef52 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091585 Jun 06 20:35:04.192232 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 20:35:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:35:06.764649 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-03b5523c-3101-437d-be93-1a04f86a7b09 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:06.765657 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-03b5523c-3101-437d-be93-1a04f86a7b09 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 06 20:35:06.766053 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:06.824508 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-9448486d-2428-406e-b33f-1b22557799d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "swap": 0, "id": "3", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:06.906721 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-9448486d-2428-406e-b33f-1b22557799d6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.135072 Jun 06 20:35:06.907283 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:35:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:06.919505 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e90d690a-777f-40a9-ab01-e5250cb159dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:06.984815 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e90d690a-777f-40a9-ab01-e5250cb159dc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069500 Jun 06 20:35:06.985405 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 20:35:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:35:09.273364 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-9448486d-2428-406e-b33f-1b22557799d6 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:09.274422 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-9448486d-2428-406e-b33f-1b22557799d6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 06 20:35:09.274852 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:09.332571 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f7bf9b17-f77d-4659-aadb-df5d7c050091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:09.391053 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f7bf9b17-f77d-4659-aadb-df5d7c050091 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.110193 Jun 06 20:35:09.391592 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:35:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:35:09.403725 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-232be9d6-d8e9-450b-816c-442bf9f379fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:09.487373 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-232be9d6-d8e9-450b-816c-442bf9f379fa admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087739 Jun 06 20:35:09.487998 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 20:35:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:35:11.791645 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f7bf9b17-f77d-4659-aadb-df5d7c050091 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:11.792753 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f7bf9b17-f77d-4659-aadb-df5d7c050091 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 06 20:35:11.793193 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:11.853406 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5"}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:11.912896 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.113580 Jun 06 20:35:11.921369 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 20:35:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:11.926493 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-91e6f926-4fa1-4163-8f1d-b91fbd097d69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:12.006967 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-91e6f926-4fa1-4163-8f1d-b91fbd097d69 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084359 Jun 06 20:35:12.007550 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 20:35:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:35:35.998455 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:35.999452 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jun 06 20:35:35.999883 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:36.010481 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:35:36.057356 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-33fc0f11-aafe-47fc-9834-f7041042dfb7 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:36.074575 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-33fc0f11-aafe-47fc-9834-f7041042dfb7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069001 Jun 06 20:35:36.079775 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 20:35:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:35:37.052909 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:37.053904 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-4dcbb64d-8c61-40d8-ae16-181f08938b16 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 06 20:35:37.054294 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:37.250344 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-6ede572b-b2b9-4595-8293-3e281233d8a2 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:37.255788 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-6ede572b-b2b9-4595-8293-3e281233d8a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-6ede572b-b2b9-4595-8293-3e281233d8a2 admin admin] Request method failure captured: Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept: application/json Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Connection: keep-alive Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Content-Length: 0 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Host: 10.222.0.41 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABinmUZhv6ISvydSbAk9loX58KHhUH2sGPAqU0ONp5guegHHFz8HMo4d4gHQlce1AtUgt7suoZ3-nL6bUoAZmD8u5J436Ulpz_zNxf4XJQRpsS4R78AWfP1ccTnfnq5b8cBGL3AcACtM4BMJ7rCdrQILjSFLJ56VpGgFel_uiGVfatcbPE Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Jun 06 20:35:37.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant: admin Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User: admin Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Name: admin Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: method: > Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: exception: Flavor 42 could not be found. Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: action_args: {'id': '42'} Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:37.260664 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:37.261992 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.263446 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-6ede572b-b2b9-4595-8293-3e281233d8a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:37.264764 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-6ede572b-b2b9-4595-8293-3e281233d8a2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061677 Jun 06 20:35:37.264764 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 20:35:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:35:37.270083 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3cc39bef-15a5-4701-bdfc-9881bd56f4b4 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:37.273069 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:35:37.293271 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3cc39bef-15a5-4701-bdfc-9881bd56f4b4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026808 Jun 06 20:35:37.293837 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:35:37.311265 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-87efce64-5bd8-44cb-a99d-37854f60640d admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:37.331917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-87efce64-5bd8-44cb-a99d-37854f60640d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024526 Jun 06 20:35:37.332438 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:35:37.342161 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-1e15af5e-5509-45b9-9524-fa92c3cbeae9 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:37.347735 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.wsgi [None req-1e15af5e-5509-45b9-9524-fa92c3cbeae9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-1e15af5e-5509-45b9-9524-fa92c3cbeae9 admin admin] Request method failure captured: Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept: application/json Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept-Encoding: gzip, deflate Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Connection: keep-alive Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Content-Length: 0 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Host: 10.222.0.41 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-System-Scope: None Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: User-Agent: python-novaclient Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Auth-Token: gAAAAABinmUZhv6ISvydSbAk9loX58KHhUH2sGPAqU0ONp5guegHHFz8HMo4d4gHQlce1AtUgt7suoZ3-nL6bUoAZmD8u5J436Ulpz_zNxf4XJQRpsS4R78AWfP1ccTnfnq5b8cBGL3AcACtM4BMJ7rCdrQILjSFLJ56VpGgFel_uiGVfatcbPE Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Id: None Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Name: None Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Identity-Status: Confirmed Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Is-Admin-Project: True Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Id: default Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Name: Default Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Name: admin Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Role: reader,admin,member Jun 06 20:35:37.350952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Roles: reader,admin,member Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant: admin Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Name: admin Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User: admin Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Id: default Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Name: Default Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Name: admin Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: method: > Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: exception: Flavor 42 could not be found. Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: action_args: {'id': '42'} Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:37.358351 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:37.359412 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:37.360703 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-1e15af5e-5509-45b9-9524-fa92c3cbeae9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:37.361978 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-1e15af5e-5509-45b9-9524-fa92c3cbeae9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014557 Jun 06 20:35:37.361978 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 20:35:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:35:38.211273 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-87efce64-5bd8-44cb-a99d-37854f60640d admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:38.212420 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-87efce64-5bd8-44cb-a99d-37854f60640d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 06 20:35:38.212812 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:38.402150 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f308c4ee-ba21-48d3-a89b-fa77c3e7964e admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:38.408306 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.wsgi [None req-f308c4ee-ba21-48d3-a89b-fa77c3e7964e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f308c4ee-ba21-48d3-a89b-fa77c3e7964e admin admin] Request method failure captured: Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept: application/json Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept-Encoding: gzip, deflate Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Connection: keep-alive Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Content-Length: 0 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Host: 10.222.0.41 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-System-Scope: None Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: User-Agent: python-novaclient Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Auth-Token: gAAAAABinmUapGys54DdGRsDgbm_eMTG1ogGN36Et6h2Jyep5rKu3pX24k7WZd6hAMEWMBioGjzxamZzCEQMwFjpHi48zk8Q93-HiiVyq_gIlqa5PezvrJhnCQDUNfN-jWRZOqJXvrOsfyUBOYfzeBPKPnEtvShmYyfTTrHPfFFUxBdd19uR0B0 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Id: None Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Name: None Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Identity-Status: Confirmed Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Is-Admin-Project: True Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Id: default Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Name: Default Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Name: admin Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Role: reader,admin,member Jun 06 20:35:38.409827 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Roles: reader,admin,member Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant: admin Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Name: admin Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User: admin Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Id: default Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Name: Default Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Name: admin Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: method: > Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: exception: Flavor 84 could not be found. Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: action_args: {'id': '84'} Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:38.411418 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:38.412465 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.413792 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f308c4ee-ba21-48d3-a89b-fa77c3e7964e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:38.415047 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-f308c4ee-ba21-48d3-a89b-fa77c3e7964e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060958 Jun 06 20:35:38.415047 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 20:35:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 06 20:35:38.421106 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-a30cc45e-54a5-4625-92ea-ced572f3236b admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:38.434328 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-a30cc45e-54a5-4625-92ea-ced572f3236b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016888 Jun 06 20:35:38.434834 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:35:38.443961 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3b54993d-5348-4fe1-93cb-89348d17ef71 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:38.458120 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3b54993d-5348-4fe1-93cb-89348d17ef71 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017579 Jun 06 20:35:38.458634 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:35:38.468230 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-dc795b8a-b011-4b13-899d-4cc9015346fa admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:38.473421 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-dc795b8a-b011-4b13-899d-4cc9015346fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-dc795b8a-b011-4b13-899d-4cc9015346fa admin admin] Request method failure captured: Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept: application/json Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Connection: keep-alive Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Content-Length: 0 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Host: 10.222.0.41 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABinmUapGys54DdGRsDgbm_eMTG1ogGN36Et6h2Jyep5rKu3pX24k7WZd6hAMEWMBioGjzxamZzCEQMwFjpHi48zk8Q93-HiiVyq_gIlqa5PezvrJhnCQDUNfN-jWRZOqJXvrOsfyUBOYfzeBPKPnEtvShmYyfTTrHPfFFUxBdd19uR0B0 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Jun 06 20:35:38.474917 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant: admin Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User: admin Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Name: admin Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: method: > Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: exception: Flavor 84 could not be found. Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: action_args: {'id': '84'} Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:38.476346 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:38.477158 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:38.478203 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-dc795b8a-b011-4b13-899d-4cc9015346fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:38.479198 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-dc795b8a-b011-4b13-899d-4cc9015346fa admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012097 Jun 06 20:35:38.479198 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 20:35:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:35:39.329989 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3b54993d-5348-4fe1-93cb-89348d17ef71 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:39.330985 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3b54993d-5348-4fe1-93cb-89348d17ef71 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 06 20:35:39.331374 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:39.516824 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-091d9857-c938-4a18-8f19-9fbf1f05c2de admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:39.522540 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-091d9857-c938-4a18-8f19-9fbf1f05c2de admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-091d9857-c938-4a18-8f19-9fbf1f05c2de admin admin] Request method failure captured: Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept: application/json Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Connection: keep-alive Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Content-Length: 0 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Host: 10.222.0.41 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABinmUbTZIDXOrlqHK7knQ0ceg2SQdiHYmLPgo3khCLQeyR8n-nvlXlR9nMnZ-1_T8ych97WsarpDWZfiCOk3Atq_jrzmkgxm3fEbGxB19ubmlqkjd7amBRm7PL4Ub3dUfJ926CLltkMy-ZdK1Nc5pseaxaBUmlWwRfq49xY1qXxWd8wIk Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Jun 06 20:35:39.524070 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant: admin Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User: admin Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: X-User-Name: admin Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: method: > Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: exception: Flavor 451 could not be found. Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: action_args: {'id': '451'} Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:39.525846 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:39.526712 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.528022 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-091d9857-c938-4a18-8f19-9fbf1f05c2de admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:39.529798 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-091d9857-c938-4a18-8f19-9fbf1f05c2de admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059730 Jun 06 20:35:39.529798 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:35:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:35:39.535866 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-b9a4b940-184c-4d61-b0bd-26aae025a213 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:39.550026 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-b9a4b940-184c-4d61-b0bd-26aae025a213 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017747 Jun 06 20:35:39.550547 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:35:39.559564 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:39.572920 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016836 Jun 06 20:35:39.573430 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 20:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:35:39.582269 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f31ab8d5-f277-4983-8d8e-27b0e42f7a93 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:39.587381 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.wsgi [None req-f31ab8d5-f277-4983-8d8e-27b0e42f7a93 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f31ab8d5-f277-4983-8d8e-27b0e42f7a93 admin admin] Request method failure captured: Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept: application/json Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Accept-Encoding: gzip, deflate Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Connection: keep-alive Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Content-Length: 0 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Host: 10.222.0.41 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-Api-Version: compute 2.90 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Openstack-System-Scope: None Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: User-Agent: python-novaclient Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Auth-Token: gAAAAABinmUbTZIDXOrlqHK7knQ0ceg2SQdiHYmLPgo3khCLQeyR8n-nvlXlR9nMnZ-1_T8ych97WsarpDWZfiCOk3Atq_jrzmkgxm3fEbGxB19ubmlqkjd7amBRm7PL4Ub3dUfJ926CLltkMy-ZdK1Nc5pseaxaBUmlWwRfq49xY1qXxWd8wIk Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Id: None Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Domain-Name: None Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Identity-Status: Confirmed Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Is-Admin-Project: True Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Id: default Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Domain-Name: Default Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Project-Name: admin Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Role: reader,admin,member Jun 06 20:35:39.588902 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Roles: reader,admin,member Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/284b2c60254e43d98184156216a03e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/284b2c60254e43d98184156216a03e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_284b2c60254e43d98184156216a03e15", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant: admin Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Id: 284b2c60254e43d98184156216a03e15 Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-Tenant-Name: admin Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User: admin Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Id: default Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Domain-Name: Default Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Id: d4f3ad3806dd4f378cf1552466225045 Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: X-User-Name: admin Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: method: > Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: exception: Flavor 451 could not be found. Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: action_args: {'id': '451'} Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:35:39.590456 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:39.591943 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: ERROR nova.api.openstack.wsgi Jun 06 20:35:39.592996 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-f31ab8d5-f277-4983-8d8e-27b0e42f7a93 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:35:39.594039 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-f31ab8d5-f277-4983-8d8e-27b0e42f7a93 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011405 Jun 06 20:35:39.594039 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:35:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:35:40.439553 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:40.440600 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 06 20:35:40.441012 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:40.627900 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3125ce63-9ff1-4cb4-bf0a-986a90cdad7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:40.710114 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3125ce63-9ff1-4cb4-bf0a-986a90cdad7a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.132067 Jun 06 20:35:40.710661 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 20:35:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:41.566753 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:41.567774 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 06 20:35:41.568169 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:41.754011 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-c1497fd3-b0e4-4608-912d-217f6f7476b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:41.870562 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-c1497fd3-b0e4-4608-912d-217f6f7476b6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.167361 Jun 06 20:35:41.871030 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 20:35:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:42.727366 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:42.728389 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 06 20:35:42.728778 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:42.915821 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-0b14e97c-1ac7-453b-a246-6a5ce6db34ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:43.001538 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-0b14e97c-1ac7-453b-a246-6a5ce6db34ca admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.136991 Jun 06 20:35:43.002080 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 20:35:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:35:43.862135 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:43.863126 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jun 06 20:35:43.863525 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:44.050123 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-8a183b75-4787-4848-86bc-ac09d622b48b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:35:44.133468 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-8a183b75-4787-4848-86bc-ac09d622b48b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134384 Jun 06 20:35:44.133926 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 20:35:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:35:44.991228 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:44.992251 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 06 20:35:44.992645 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:35:45.179900 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-96e4d3da-daba-41e1-8898-4c2ee073e9f9 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:35:45.198779 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-96e4d3da-daba-41e1-8898-4c2ee073e9f9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069904 Jun 06 20:35:45.199310 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Mon Jun 6 20:35:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:36:45.795934 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.796993 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-e51dff96-b77c-416f-b70f-79fc14ef3ec5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 06 20:36:45.797384 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:36:45.809095 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:36:45.856459 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-8affd64e-3416-4523-a08a-0f4d96d0e162 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.875398 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-8affd64e-3416-4523-a08a-0f4d96d0e162 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072028 Jun 06 20:36:45.875963 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:36:45.896438 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=14 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:36:45.900486 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-bc86d599-b93d-42b1-ac5c-36d153084ae2 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.908492 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-bc86d599-b93d-42b1-ac5c-36d153084ae2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013472 Jun 06 20:36:45.909023 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:36:45.920131 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-6b336eb1-947b-47b2-958b-1b95aebed9af admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.928138 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-6b336eb1-947b-47b2-958b-1b95aebed9af admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011606 Jun 06 20:36:45.928661 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:36:45.939497 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.947202 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011135 Jun 06 20:36:45.947740 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:36:45.959463 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-e3b61adc-f616-44e9-8cb5-64476f711b60 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:36:45.967633 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-e3b61adc-f616-44e9-8cb5-64476f711b60 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011850 Jun 06 20:36:45.968188 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Mon Jun 6 20:36:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:40:06.028255 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:06.029262 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 06 20:40:06.029657 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:40:06.187757 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_api:SELECT=6 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:40:06.304158 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:06.305323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:40:06.305323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:40:06.307126 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:06.307559 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:06.308347 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:06.308766 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:06.341474 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-3af69d18-d50a-4b09-86c7-609a3e787bf1 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155516 Jun 06 20:40:06.342026 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:40:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:40:07.210312 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:07.211646 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Jun 06 20:40:07.212268 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:40:07.401487 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:07.402707 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:40:07.402707 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:40:07.403925 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:07.404362 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:07.405136 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:07.405563 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:07.424506 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-e139c2d3-d258-48fa-93af-d7781ac95514 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074812 Jun 06 20:40:07.425043 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:40:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:40:18.684489 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:18.685528 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 06 20:40:18.685922 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:40:18.826597 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_cell0:SELECT=4 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:40:18.827323 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_cell1:SELECT=4 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:40:18.827952 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG dbcounter [-] [110180] Writing DB stats nova_api:SELECT=8 {{(pid=110180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:40:18.877219 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:18.878066 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:40:18.878066 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:40:18.879233 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:18.879705 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:18.880472 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:18.880922 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:18.905840 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-cc8938a5-a866-4e47-9faf-a3c442ab60e3 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083879 Jun 06 20:40:18.906109 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:40:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:40:19.776625 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:19.777665 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-95dbb5f5-e69e-4899-899d-3cb1f2943f69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 06 20:40:19.778054 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 20:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:40:19.965681 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG nova.api.openstack.wsgi [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] Calling method '>' {{(pid=110180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:40:19.966837 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:40:19.966837 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: warnings.warn(msg) Jun 06 20:40:19.968035 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:19.968467 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:19.969260 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:40:19.969677 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: DEBUG oslo_concurrency.lockutils [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:40:19.991620 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: INFO nova.api.openstack.requestlog [None req-40b05acb-8db5-4929-8fa8-4cadf8df4683 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078087 Jun 06 20:40:19.992121 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: [pid: 110180|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 20:40:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:41:16.191712 dv-cinder-844879-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 20:41:16.192300 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: Mon Jun 6 20:41:16 2022 - graceful shutdown triggered... Jun 06 20:41:16.192810 dv-cinder-844879-1-iscsi devstack@n-api.service[110179]: Gracefully killing worker 1 (pid: 110179)... Jun 06 20:41:16.193258 dv-cinder-844879-1-iscsi devstack@n-api.service[110180]: Gracefully killing worker 2 (pid: 110180)... Jun 06 20:41:17.193247 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: worker 1 buried after 1 seconds Jun 06 20:41:17.193247 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: worker 2 buried after 1 seconds Jun 06 20:41:17.193247 dv-cinder-844879-1-iscsi devstack@n-api.service[110178]: goodbye to uWSGI. Jun 06 20:41:17.194790 dv-cinder-844879-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 20:41:17.195360 dv-cinder-844879-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 20:41:17.198449 dv-cinder-844879-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 20:41:17.213950 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 20:41:17 2022] *** Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: nodename: dv-cinder-844879-1-iscsi Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: machine: x86_64 Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: clock source: unix Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: pcre jit disabled Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: detected number of CPU cores: 4 Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: current working directory: / Jun 06 20:41:17.233057 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: detected binary path: /usr/bin/uwsgi-core Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: your processes number limit is 47680 Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: your memory page size is 4096 bytes Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: detected max file descriptor number: 2048 Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: lock engine: pthread robust mutexes Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: thunder lock: enabled Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 20:41:17.233869 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 20:41:17.280093 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: Python main interpreter initialized at 0x5631643279c0 Jun 06 20:41:17.280093 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: python threads support enabled Jun 06 20:41:17.280093 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: your server socket listen backlog is limited to 100 connections Jun 06 20:41:17.280093 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: your mercy for graceful operations on workers is 90 seconds Jun 06 20:41:17.280546 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 20:41:17.280546 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: *** Operational MODE: preforking *** Jun 06 20:41:17.280798 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: *** uWSGI is running in multiple interpreter mode *** Jun 06 20:41:17.280798 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: spawned uWSGI master process (pid: 124564) Jun 06 20:41:17.281002 dv-cinder-844879-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 20:41:17.282055 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: spawned uWSGI worker 1 (pid: 124578, cores: 1) Jun 06 20:41:17.282603 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: spawned uWSGI worker 2 (pid: 124579, cores: 1) Jun 06 20:41:17.283803 dv-cinder-844879-1-iscsi devstack@n-api.service[124564]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 20:41:18.506906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:41:18.507511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:41:19.326517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:41:19.326517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: from cryptography.utils import int_from_bytes Jun 06 20:41:19.326812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:41:19.326812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: from cryptography.utils import int_from_bytes Jun 06 20:41:19.326950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:41:19.326950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: from cryptography.utils import int_from_bytes Jun 06 20:41:19.327082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:41:19.327082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: from cryptography.utils import int_from_bytes Jun 06 20:41:21.663541 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:41:21.664253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:41:21.664253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:41:21.664630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:41:21.664858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:41:21.664972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:41:21.665339 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:41:21.665424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.665609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.665742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:41:21.665909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.666073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:41:21.666225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.666326 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:41:21.666526 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.666701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.666854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.667010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.667177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.667355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668222 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.668966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-1-iscsi {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669499 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669602 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669848 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.669951 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670109 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670411 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670540 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.670846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844879-1-iscsi {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671542 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.671890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.672061 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.672300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.672631 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.672939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.673420 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.673690 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.673957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.674176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.674176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.674613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.674838 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.675057 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.675281 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.675500 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.675735 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.675983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.676213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.676424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.676632 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.676857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.677083 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.677306 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.677523 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.677740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.677961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.678184 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-1-iscsi {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.678402 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844879-1-iscsi {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.678592 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.678814 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.679019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.679187 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.679341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.679527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.679768 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.680195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.680359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.680515 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.680672 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.680835 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681677 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.681979 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.682135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.682292 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.682529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.682710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.682940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684111 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684621 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.684934 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685086 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.685853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686163 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686320 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.686937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687405 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687758 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.687918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.688860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689019 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.689946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.690322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.690483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.690640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.690786 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.690945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.691180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.691415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.691576 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.691753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.691906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.692069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.692906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.693165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.693403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.693564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.693711 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.693868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.694368 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.694533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.694689 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.694842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.694996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695290 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695620 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.695962 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696580 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.696890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697420 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697571 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.697894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698040 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698345 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698814 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.698960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699113 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699572 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.699938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.700096 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.700515 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.700677 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.700831 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.700989 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.701171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.701420 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.701642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.701801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.701958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702104 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702716 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.702956 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.703148 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.703403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.703633 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.703828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.703983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.704140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.704304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.704565 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.704741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.704895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.705047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.705415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.705570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.705730 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.705878 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706030 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706651 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.706970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707413 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707608 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.707959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708592 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.708951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709133 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709412 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709880 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.709967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710252 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710661 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710771 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710861 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.710956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711050 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711150 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711238 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711329 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711487 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711585 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.711957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712049 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712142 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712415 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712501 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712687 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712776 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712870 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.712977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.713066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.713151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.713246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.713349 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:41:21.713451 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.713539 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.713772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.713868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.713954 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714048 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714149 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714550 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714700 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.714989 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715076 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715518 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715726 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.715984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716651 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716737 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.716926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717021 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717115 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717209 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717562 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717649 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.717912 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718077 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718184 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718278 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718371 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718654 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718843 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.718936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719125 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719730 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.719931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.720936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721093 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721361 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721866 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.721960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722291 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722502 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.722919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723129 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723236 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.723948 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724397 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.724833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725113 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725311 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725404 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.725920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726324 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726547 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726852 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.726952 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.727922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728754 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.728848 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729061 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729152 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729485 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.729787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.730532 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.730698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.730890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731238 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.731882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732048 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732353 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732502 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732653 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.732964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.733981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.734916 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735221 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.735855 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736026 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736176 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.736980 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737498 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737593 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.737901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738207 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.738809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.739020 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.739120 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.739337 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.739430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.739623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.740630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.740630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741292 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741469 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.741994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742090 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742357 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.742788 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743015 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743677 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.743814 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744013 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744141 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744316 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744410 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744628 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744730 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.744938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.745038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.745251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.745347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.745563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.746248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.746447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.746577 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.746762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.746886 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.747872 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748362 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748463 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748670 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748778 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.748987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749421 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749660 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749771 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.749976 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750107 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750404 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750618 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.750937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.751053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.751247 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.751362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.751554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.751699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.761761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.761761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.761761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762110 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762393 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762577 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762672 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762768 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.762971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763153 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763349 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763443 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763751 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763847 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.763946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764040 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764784 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.764942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765157 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765340 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765440 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765703 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765896 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.765996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766071 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766164 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766257 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.766954 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767378 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767784 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.767909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768266 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768624 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.768995 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769368 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769721 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769817 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.769910 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770003 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770159 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.770973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771057 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771234 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771333 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.771996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772252 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772344 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772531 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.772907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773000 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.773979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774113 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774665 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774759 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.774858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775192 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775285 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.775927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776111 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776196 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776294 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776382 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776643 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776738 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.776860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777440 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.777994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778608 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778791 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.778971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779392 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.779920 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780103 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780265 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780519 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.780830 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.781962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782056 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.782913 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783006 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783350 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783562 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783718 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.783922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784233 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784377 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.784867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785012 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785493 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785597 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785714 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.785818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786656 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786759 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.786963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.787231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.787359 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.787472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.787575 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.787684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.790491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.790640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.790749 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.790851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.790950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791149 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791324 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791506 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.791947 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.792040 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.792136 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.792231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.792329 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.792425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793131 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793870 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.793958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794146 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794240 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794435 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794738 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.794911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795692 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.795874 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.796961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.797107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.797413 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.797585 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.797727 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.797882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798334 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798487 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798629 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.798929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799221 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.799990 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800397 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800597 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800700 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.800990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.801218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.801312 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.801526 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.801635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.801890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802613 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802820 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.802960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.803897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804194 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804717 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.804833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805027 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805138 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.805951 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806057 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806366 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806572 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806874 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.806997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.807232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.807370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.807496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.807600 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.807906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.808068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.808756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.808900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809044 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809188 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809495 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.809942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.810897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811225 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.811853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812025 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812754 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.812898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813127 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.813843 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814162 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814465 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814608 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.814911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815074 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815220 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.815930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816080 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.816812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817028 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817339 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.817940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818354 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818700 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818883 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.818977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819189 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819556 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.819990 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820222 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820530 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820832 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.820931 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821539 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.821846 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822466 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822776 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.822986 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.823081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.823289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.823480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.823606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.823856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.824818 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825504 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.825819 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826030 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826353 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826677 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826773 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.826983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.827947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828269 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828375 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828580 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.828997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.829953 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830256 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830583 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.830950 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831588 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831805 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.831959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832116 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832212 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.832906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833353 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833505 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833811 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.833955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834277 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.834957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835572 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835773 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.835924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836384 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836543 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836838 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.836988 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837131 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.837923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838074 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838826 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.838970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839120 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839425 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.839888 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840212 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840660 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.840965 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.841950 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842274 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.842909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843219 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843770 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.843869 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844477 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844688 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.844998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.845908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846013 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846525 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846618 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846847 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.846955 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847261 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847558 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.847945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848113 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848225 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848542 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.848871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849179 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.849814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.850984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851077 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851300 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851402 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851613 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.851957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852373 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852588 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.852907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.853857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.854081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.854176 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.854396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.854631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.854732 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.855471 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.855574 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.855822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.855933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856450 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856764 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.856872 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857488 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.857808 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.858977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859282 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859629 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859793 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.859972 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860077 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860385 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860700 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.860916 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861018 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861866 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.861968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862180 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862274 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.862911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863120 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863220 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.863958 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864405 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.864821 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865030 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865663 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.865996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866508 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.866940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.867176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.867271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.867505 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.867759 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.867868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868238 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.868833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869682 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.869990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.870085 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.870298 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.870399 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.870705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.871298 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.871508 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.871648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.871844 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.871956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.872152 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.872253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.872473 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.872686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.872788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873357 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.873772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.874867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875612 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.875966 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876477 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876578 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.876885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877090 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877505 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877711 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.877814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878320 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878452 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.878943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879054 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879247 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879558 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879888 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.879990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880337 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880506 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880608 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.880901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881115 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881220 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881422 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.881829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.882945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883339 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883884 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.883987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884196 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884297 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884500 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884594 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.884904 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885461 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885569 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.885855 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.886815 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887041 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887368 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.887969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888312 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888495 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.888992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889290 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889846 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.889950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.890891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891103 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891198 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.891861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892174 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892470 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.892995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893406 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893716 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.893924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.894098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.894231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.894325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.894792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.894898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895206 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.895852 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896059 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896155 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896394 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.896804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897653 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.897987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898609 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.898916 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899238 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.899905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.900927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901026 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901707 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.901901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902590 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902694 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.902999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903755 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.903946 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.904894 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905114 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905222 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.905825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906337 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.906949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907561 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907682 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.907986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908502 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.908915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909728 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.909857 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910142 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910333 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.910936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911240 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911698 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911893 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.911992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912594 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.912905 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913473 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.913968 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.914997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915147 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915590 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.915923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916669 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916879 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.916984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.917193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.917297 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918027 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.918967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919289 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.919964 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920286 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920388 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920604 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.920921 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921025 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921680 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.921993 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922271 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.922906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.923867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924519 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.924841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925374 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925481 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.925802 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926333 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:41:21.926677 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.926997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.927313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.927624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.927971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:41:21.928218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:41:21.986798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO dbcounter [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Registered counter for database nova_api Jun 06 20:41:21.987907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO dbcounter [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Registered counter for database nova_api Jun 06 20:41:22.007054 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_db.sqlalchemy.engines [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.008693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_db.sqlalchemy.engines [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.013757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writer thread running {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.015321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writer thread running {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.069248 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.context [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d772098-9589-43ac-94cf-689c77728b5a(cell1) {{(pid=124578) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:41:22.071474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.context [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d772098-9589-43ac-94cf-689c77728b5a(cell1) {{(pid=124579) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:41:22.073317 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:41:22.075227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:41:22.075600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:41:22.076056 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:41:22.077517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:41:22.077992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:41:22.078338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:41:22.079960 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO dbcounter [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Registered counter for database nova_cell0 Jun 06 20:41:22.080328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:41:22.082310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO dbcounter [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Registered counter for database nova_cell0 Jun 06 20:41:22.085356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO dbcounter [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Registered counter for database nova_cell1 Jun 06 20:41:22.087605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO dbcounter [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Registered counter for database nova_cell1 Jun 06 20:41:22.093096 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_db.sqlalchemy.engines [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.095772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_db.sqlalchemy.engines [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.096664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_db.sqlalchemy.engines [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.098290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_db.sqlalchemy.engines [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.098486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writer thread running {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.103930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writer thread running {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.107262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writer thread running {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.244429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writer thread running {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.252512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO dbcounter [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Registered counter for database nova_cell0 Jun 06 20:41:22.253142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO dbcounter [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Registered counter for database nova_cell0 Jun 06 20:41:22.259160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_db.sqlalchemy.engines [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.261072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_db.sqlalchemy.engines [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:41:22.263934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writer thread running {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.271160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writer thread running {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:41:22.701946 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: WARNING keystonemiddleware.auth_token [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:41:22.709199 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: WARNING keystonemiddleware.auth_token [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:41:22.715997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: WARNING keystonemiddleware.auth_token [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:41:22.723265 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: WARNING keystonemiddleware.auth_token [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:41:22.933576 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: WARNING keystonemiddleware.auth_token [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:41:22.939559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: WARNING keystonemiddleware.auth_token [None req-6750a0c2-2552-4773-b79b-b74b0b47ebb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:41:22.944883 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5631643279c0 pid: 124579 (default app) Jun 06 20:41:22.946725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: WARNING keystonemiddleware.auth_token [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:41:22.953366 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: WARNING keystonemiddleware.auth_token [None req-581673f0-7619-4988-8283-08e9b1a6ba83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:41:22.958595 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5631643279c0 pid: 124578 (default app) Jun 06 20:42:04.855889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:04.860407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:04.860407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:04.860407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:05.552310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:05.553369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:05.554469 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:05.555551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:06.045267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5cf9cd5c-f20a-4f37-b419-31fb8b889e08 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Action: 'create', calling method: .version_select at 0x7fdaec260700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2115716800", "metadata": {"Type": "work"}}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:06.385775 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0808c810-e42d-4594-88f8-2257b8870967 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Action: 'create', calling method: .version_select at 0x7fdaec261700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-486065111"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:07.793163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5cf9cd5c-f20a-4f37-b419-31fb8b889e08 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.947408 Jun 06 20:42:07.794431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 20:42:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2950 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 20:42:07.810425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3bb49bc2-9d6c-499d-8145-91f8c520b42e tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec129670>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:07.942068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0808c810-e42d-4594-88f8-2257b8870967 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.399505 Jun 06 20:42:07.942666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 1/2] 10.222.0.41 () {60 vars in 1154 bytes} [Mon Jun 6 20:42:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 20:42:07.964827 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1ef37960-6efe-4c4f-a4b4-f7069ebaf8e5 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec12c670>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:08.160803 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3bb49bc2-9d6c-499d-8145-91f8c520b42e tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 353 microversion: 2.1 time: 0.357909 Jun 06 20:42:08.161891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:07 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 353 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:08.255481 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1ef37960-6efe-4c4f-a4b4-f7069ebaf8e5 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 200 len: 344 microversion: 2.1 time: 0.294807 Jun 06 20:42:08.256471 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:07 2022] GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 344 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:08.273359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2127318554", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "networks": [{"uuid": "3ebdbdd3-4f2c-4696-bc67-9cb49af919b4"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:08.412039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] validate_networks() for [('3ebdbdd3-4f2c-4696-bc67-9cb49af919b4', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:42:09.182692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-63c31cc5-0452-4c49-83a7-2d608c7b3898 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec12c8b0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:09.301534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-63c31cc5-0452-4c49-83a7-2d608c7b3898 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 353 microversion: 2.1 time: 0.131274 Jun 06 20:42:09.302832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 3/5] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:09 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:09.309809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cffda072-c184-4dbf-9d0a-32e341ad9d20 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec12ce50>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:09.392489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cffda072-c184-4dbf-9d0a-32e341ad9d20 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 200 len: 345 microversion: 2.1 time: 0.088536 Jun 06 20:42:09.394394 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 4/6] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:09 2022] GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:09.408616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-401eafd6-9728-448e-a852-08b55e7214b3 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Action: 'create', calling method: .version_select at 0x7fdaec13e4c0>, body: {"snapshot": {"volume_id": "07f88a56-70a6-45bc-9680-4fb813917a61", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1963406020"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:09.825453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:42:09.826375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:42:09.826981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:42:09.833683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:42:09.833683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:42:09.854634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:09.856132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:09.857542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:09.858268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:09.910553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Getting quotas for project 7baa5449b82446198b16e944162aa85b. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:09.918623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Getting quotas for user 9583c43bffb24329b5e06b1e749affd8 and project 7baa5449b82446198b16e944162aa85b. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:09.934429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:42:09.937200 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:42:10.144425 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-401eafd6-9728-448e-a852-08b55e7214b3 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.740390 Jun 06 20:42:10.145382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 5/7] 10.222.0.41 () {60 vars in 1161 bytes} [Mon Jun 6 20:42:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.156710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5281b95a-4bd3-4733-8e95-c243cf5789f3 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec12cd30>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.169056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-07499b7f-a5a1-4843-9e34-2697258f48e9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.003182 Jun 06 20:42:10.169750 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 3/8] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:42:10.184241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-633b32ef-5c06-4bc8-a686-c3d0baa84bae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.197174 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-633b32ef-5c06-4bc8-a686-c3d0baa84bae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:10.233554 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5281b95a-4bd3-4733-8e95-c243cf5789f3 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.082435 Jun 06 20:42:10.242698 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 6/9] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.253708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c100b634-cd45-4c2f-a7b5-36dcf2dd5383 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec12c940>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.371626 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c100b634-cd45-4c2f-a7b5-36dcf2dd5383 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.102931 Jun 06 20:42:10.371626 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 7/10] 10.222.0.41 () {58 vars in 1139 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.371626 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-69230ed5-5568-4e5d-95f5-35671a602341 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec13e1f0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.439065 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-69230ed5-5568-4e5d-95f5-35671a602341 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 354 microversion: 2.1 time: 0.087285 Jun 06 20:42:10.439635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 8/11] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.444386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e588899e-ebc4-4ca4-804c-2a5dba30862a tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec13e820>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.506809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-633b32ef-5c06-4bc8-a686-c3d0baa84bae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:10.508024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-633b32ef-5c06-4bc8-a686-c3d0baa84bae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1215 microversion: 2.1 time: 0.329080 Jun 06 20:42:10.509058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 4/12] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:10.520425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ae48c053-79b0-4178-8193-b150ff519e3c tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec04f670>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.536499 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e588899e-ebc4-4ca4-804c-2a5dba30862a tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.095572 Jun 06 20:42:10.538367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 9/13] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.650915 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ae48c053-79b0-4178-8193-b150ff519e3c tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 354 microversion: 2.1 time: 0.139790 Jun 06 20:42:10.654241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 5/14] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:10.669257 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e05f50a9-6f96-4e0c-b7d4-463d1f174edb tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec13eca0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:10.990275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e05f50a9-6f96-4e0c-b7d4-463d1f174edb tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 202 len: 0 microversion: 2.1 time: 0.325400 Jun 06 20:42:10.991453 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 10/15] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:42:10 2022] DELETE /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:42:11.002164 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9e5aac15-f542-41c3-9e4d-bd8b18d7d1cb tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaeaff1820>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:11.154659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9e5aac15-f542-41c3-9e4d-bd8b18d7d1cb tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 353 microversion: 2.1 time: 0.159191 Jun 06 20:42:11.156393 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 6/16] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:10 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:11.526381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-23ebb30e-0f46-42f2-aa44-f92874ba97a2 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:11.527578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-23ebb30e-0f46-42f2-aa44-f92874ba97a2 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:11.550583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-44680f08-7b04-4345-84f7-ec910c016c2e tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec04f670>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:11.583897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-44680f08-7b04-4345-84f7-ec910c016c2e tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.037800 Jun 06 20:42:11.584811 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 7/17] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:11 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:11.700667 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-23ebb30e-0f46-42f2-aa44-f92874ba97a2 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:11.718919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-23ebb30e-0f46-42f2-aa44-f92874ba97a2 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1215 microversion: 2.1 time: 0.196329 Jun 06 20:42:11.719751 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 11/18] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:11 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:12.168960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6273f1b3-511e-4e37-9965-c079f6d773fd tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaeaff1550>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:12.336792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6273f1b3-511e-4e37-9965-c079f6d773fd tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 353 microversion: 2.1 time: 0.172316 Jun 06 20:42:12.337358 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 8/19] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:12 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:12.596364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a62963b7-eb08-4095-a50d-16c998427ffe tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec103310>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:12.659857 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a62963b7-eb08-4095-a50d-16c998427ffe tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.066909 Jun 06 20:42:12.660924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 12/20] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:12 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:12.740080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:12.740080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:12.758714 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:12.759361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:12.762340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:12.769506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:13.236225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:13.255643 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1053b2c2-07d6-4891-a16e-a8d855babdbf tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1219 microversion: 2.1 time: 0.522105 Jun 06 20:42:13.268326 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 9/21] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:12 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1219 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:13.349255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e6185cc9-6134-4fe1-bfd3-480241d12a79 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaec1124c0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:13.456308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e6185cc9-6134-4fe1-bfd3-480241d12a79 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 200 len: 353 microversion: 2.1 time: 0.110388 Jun 06 20:42:13.457311 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 13/22] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:13 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:13.673507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-12b2cba4-9807-4876-9ac8-b7925243880e tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaeaf750d0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:13.749173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-12b2cba4-9807-4876-9ac8-b7925243880e tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.080456 Jun 06 20:42:13.755285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 10/23] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:13 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:14.276048 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:14.277563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:14.300859 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:14.303563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:14.304505 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:14.305047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:14.469999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fd4d9f31-19a9-4931-9ac0-f5d2c03da875 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Calling method '.version_select at 0x7fdaeaf75820>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:14.517658 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-fd4d9f31-19a9-4931-9ac0-f5d2c03da875 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] HTTP exception thrown: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fd4d9f31-19a9-4931-9ac0-f5d2c03da875 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Request method failure captured: Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db HTTP/1.1 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmacgz-aARYYPgqgAcJLb5SMIwUHFGa3CnCLxw4MWilLhw7rVhmW-puzUwQrE-gIaC-oNeb8Fm8fw5ke1xhyGFYkWvXyZgLcr03FrbLGDyiSj_WElALnkcjU5hOieBwE3l5KJ3FBLefrbavDO0EWf0C2LjggXBGtuYawksM9AHi98ig Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: eb56f6104d014f75bc5809840c2277a6 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesGetTestJSON-1110646079 Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:42:14.528069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/eb56f6104d014f75bc5809840c2277a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/eb56f6104d014f75bc5809840c2277a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/eb56f6104d014f75bc5809840c2277a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_eb56f6104d014f75bc5809840c2277a6", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesGetTestJSON-1110646079 Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: eb56f6104d014f75bc5809840c2277a6 Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesGetTestJSON-1110646079 Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesGetTestJSON-1110646079-project Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 772261cd4bbe4e07a20919e144f9291b Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesGetTestJSON-1110646079-project Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'c963456c-4f88-44df-a94e-944d491c95db'} Jun 06 20:42:14.529138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. (HTTP 404) (Request-ID: req-36e50d1a-eb94-40ec-bbf9-c0a5027ec059) Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:14.529792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:14.530713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 20:42:14.531600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fd4d9f31-19a9-4931-9ac0-f5d2c03da875 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] Returning 404 to user: Volume c963456c-4f88-44df-a94e-944d491c95db could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fd4d9f31-19a9-4931-9ac0-f5d2c03da875 tempest-VolumesGetTestJSON-1110646079 tempest-VolumesGetTestJSON-1110646079-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db" status: 404 len: 109 microversion: 2.1 time: 0.058241 Jun 06 20:42:14.532586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 11/24] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:14 2022] GET /compute/v2.1/os-volumes/c963456c-4f88-44df-a94e-944d491c95db => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:42:14.763074 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c6ce204c-c2cf-43bf-a5ef-81833aeb9245 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaeaf83700>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:14.784536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:14.806792 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f0d44c53-9e5a-4b1d-a188-528c0a5ebc7b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1267 microversion: 2.1 time: 0.535951 Jun 06 20:42:14.809489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:14 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1267 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:14.819851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c6ce204c-c2cf-43bf-a5ef-81833aeb9245 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 288 microversion: 2.1 time: 0.052463 Jun 06 20:42:14.819851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 12/26] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:14 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:14.835002 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9a9e8b43-db3e-4cfe-bc7f-59b001509512 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaecb0f8b0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:15.031390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9a9e8b43-db3e-4cfe-bc7f-59b001509512 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 202 len: 0 microversion: 2.1 time: 0.200760 Jun 06 20:42:15.032766 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 13/27] 10.222.0.41 () {58 vars in 1253 bytes} [Mon Jun 6 20:42:14 2022] DELETE /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:42:15.052793 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2f9fc23c-171e-4415-8bf6-ab4f16115c4d tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec0929d0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:15.140025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2f9fc23c-171e-4415-8bf6-ab4f16115c4d tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 200 len: 287 microversion: 2.1 time: 0.100932 Jun 06 20:42:15.140688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 15/28] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:15 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:15.829507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:15.830316 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:15.847730 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:15.848218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:15.853062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:15.856049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:16.013189 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:16.036496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c8252b2e-04e2-4b09-a137-e0f13fc5e12b tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1273 microversion: 2.1 time: 0.213772 Jun 06 20:42:16.037430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:15 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:16.153357 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b459c8e2-5d92-483a-b672-6bf9ac492963 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaec01a160>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:16.200545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-b459c8e2-5d92-483a-b672-6bf9ac492963 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] HTTP exception thrown: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b459c8e2-5d92-483a-b672-6bf9ac492963 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Request method failure captured: Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a HTTP/1.1 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmadEdsqzwb60g3AOl5SXDLHULrTwz7iJgxwU64MxqSxRIebQBh1VyMRBik-NDLlqRrLiB4U7I-UNjx4sHusUvJD6pUCbw_kM1yZMTVBQt2iyYJ9ZAFPtooAILxggzy0CyLnypz7wLYjLWfvft588nHBfq_RQG4zqBVh1EQHosuH4jQ Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:42:16.204899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f3894355fc424d08abe9e2fe0f66a7a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: f80b80a88c2d4e57a58eaafd431d4e93 Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '56427988-0964-4735-ad93-7aa13a6ced9a'} Jun 06 20:42:16.205963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. (HTTP 404) (Request-ID: req-cab3943f-3006-45dc-96e3-ac4522a29be2) Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.206673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:16.207491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 20:42:16.208381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b459c8e2-5d92-483a-b672-6bf9ac492963 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Returning 404 to user: Snapshot 56427988-0964-4735-ad93-7aa13a6ced9a could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b459c8e2-5d92-483a-b672-6bf9ac492963 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a" status: 404 len: 111 microversion: 2.1 time: 0.058068 Jun 06 20:42:16.210757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 16/30] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 20:42:16 2022] GET /compute/v2.1/os-snapshots/56427988-0964-4735-ad93-7aa13a6ced9a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:42:16.223150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da22ee1b-4dd7-4632-b7c5-39023ebfcc46 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaeae975e0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:16.593686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-da22ee1b-4dd7-4632-b7c5-39023ebfcc46 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 202 len: 0 microversion: 2.1 time: 0.381128 Jun 06 20:42:16.595886 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 15/31] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:42:16 2022] DELETE /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:42:16.604460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-548fbce8-cdd7-4db1-87bf-9ef7436a14de tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaebfb60d0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:16.683780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-548fbce8-cdd7-4db1-87bf-9ef7436a14de tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 200 len: 344 microversion: 2.1 time: 0.082915 Jun 06 20:42:16.687615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 17/32] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:16 2022] GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:17.062740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:17.062740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:17.092429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:17.093574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:17.095891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:17.099249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:17.698467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b3d6d457-d7be-40c4-a245-ab8307a55dcd tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaebfb6820>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:17.767699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-b3d6d457-d7be-40c4-a245-ab8307a55dcd tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] HTTP exception thrown: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b3d6d457-d7be-40c4-a245-ab8307a55dcd tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Request method failure captured: Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 HTTP/1.1 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmadEdsqzwb60g3AOl5SXDLHULrTwz7iJgxwU64MxqSxRIebQBh1VyMRBik-NDLlqRrLiB4U7I-UNjx4sHusUvJD6pUCbw_kM1yZMTVBQt2iyYJ9ZAFPtooAILxggzy0CyLnypz7wLYjLWfvft588nHBfq_RQG4zqBVh1EQHosuH4jQ Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:42:17.771721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f3894355fc424d08abe9e2fe0f66a7a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: f80b80a88c2d4e57a58eaafd431d4e93 Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '07f88a56-70a6-45bc-9680-4fb813917a61'} Jun 06 20:42:17.772794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. (HTTP 404) (Request-ID: req-3b92ef34-f24c-4304-b205-7deedb7d83e2) Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.773408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:17.774267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 20:42:17.775172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b3d6d457-d7be-40c4-a245-ab8307a55dcd tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Returning 404 to user: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:42:17.780565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b3d6d457-d7be-40c4-a245-ab8307a55dcd tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 404 len: 109 microversion: 2.1 time: 0.085283 Jun 06 20:42:17.782193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 18/33] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:17 2022] GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:42:17.802951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5791c476-deb4-45eb-820c-2ea9dfb1b456 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaebfb6430>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:17.824577 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:17.839460 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-44c644f6-34d8-4e6f-83d0-250976bdea0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1273 microversion: 2.1 time: 0.788226 Jun 06 20:42:17.840431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 16/34] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:17 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1273 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:17.872432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-5791c476-deb4-45eb-820c-2ea9dfb1b456 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] HTTP exception thrown: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5791c476-deb4-45eb-820c-2ea9dfb1b456 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Request method failure captured: Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 HTTP/1.1 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmadEdsqzwb60g3AOl5SXDLHULrTwz7iJgxwU64MxqSxRIebQBh1VyMRBik-NDLlqRrLiB4U7I-UNjx4sHusUvJD6pUCbw_kM1yZMTVBQt2iyYJ9ZAFPtooAILxggzy0CyLnypz7wLYjLWfvft588nHBfq_RQG4zqBVh1EQHosuH4jQ Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:42:17.874385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f3894355fc424d08abe9e2fe0f66a7a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: f80b80a88c2d4e57a58eaafd431d4e93 Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '07f88a56-70a6-45bc-9680-4fb813917a61'} Jun 06 20:42:17.875637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. (HTTP 404) (Request-ID: req-bdf58b3b-6e88-4c93-8de7-57a3874e26b2) Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.876419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:42:17.877675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 20:42:17.878766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5791c476-deb4-45eb-820c-2ea9dfb1b456 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Returning 404 to user: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5791c476-deb4-45eb-820c-2ea9dfb1b456 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 404 len: 109 microversion: 2.1 time: 0.083711 Jun 06 20:42:17.880012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 19/35] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:42:17 2022] DELETE /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:42:17.888568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b6b779f1-f3b7-4456-ab8f-c491e924d901 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Calling method '.version_select at 0x7fdaeae97670>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:17.943540 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-b6b779f1-f3b7-4456-ab8f-c491e924d901 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] HTTP exception thrown: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b6b779f1-f3b7-4456-ab8f-c491e924d901 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Request method failure captured: Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 HTTP/1.1 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmadEdsqzwb60g3AOl5SXDLHULrTwz7iJgxwU64MxqSxRIebQBh1VyMRBik-NDLlqRrLiB4U7I-UNjx4sHusUvJD6pUCbw_kM1yZMTVBQt2iyYJ9ZAFPtooAILxggzy0CyLnypz7wLYjLWfvft588nHBfq_RQG4zqBVh1EQHosuH4jQ Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:42:17.947213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f3894355fc424d08abe9e2fe0f66a7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f3894355fc424d08abe9e2fe0f66a7a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: f3894355fc424d08abe9e2fe0f66a7a7 Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-111647990 Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: f80b80a88c2d4e57a58eaafd431d4e93 Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesSnapshotsTestJSON-111647990-project Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '07f88a56-70a6-45bc-9680-4fb813917a61'} Jun 06 20:42:17.948288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. (HTTP 404) (Request-ID: req-6ccdf4b4-daa7-4688-a346-3d562ca18550) Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.948991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:42:17.949890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 20:42:17.950755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. Jun 06 20:42:17.952683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:42:17.955375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b6b779f1-f3b7-4456-ab8f-c491e924d901 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] Returning 404 to user: Volume 07f88a56-70a6-45bc-9680-4fb813917a61 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:42:17.957049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b6b779f1-f3b7-4456-ab8f-c491e924d901 tempest-VolumesSnapshotsTestJSON-111647990 tempest-VolumesSnapshotsTestJSON-111647990-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61" status: 404 len: 109 microversion: 2.1 time: 0.073021 Jun 06 20:42:17.960680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 17/36] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:42:17 2022] GET /compute/v2.1/os-volumes/07f88a56-70a6-45bc-9680-4fb813917a61 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:42:18.858316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:18.858926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:18.874301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:18.876571 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:18.879557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:18.882863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:19.040920 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:19.052959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cbe0ad77-7196-4003-8525-b039d3c175e1 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1273 microversion: 2.1 time: 0.198921 Jun 06 20:42:19.059874 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 20/37] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:18 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:20.067909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:20.075492 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:20.076568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:20.089690 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:20.092683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:20.093928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:20.094521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:20.507303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=8 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:21.192123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:21.206394 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-130ba30c-af11-468f-9b22-e97b0aecc5eb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 1.139257 Jun 06 20:42:21.207233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 18/38] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:20 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:22.074579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:22.223310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:22.225033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:22.237517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:22.237969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:22.238752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:22.239188 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:22.616493 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7a12f4d1-f8f6-49a7-bb38-67a44d42e32b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: .version_select at 0x7fdaebfd1dc0>, body: {"keypair": {"name": "tempest-keypair-1109419621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo8ySK+9pB+7BP1x/jNqNQUsfxUCXX8rgcot+Sjspt46FsAeDWmtEZST1N3CqbGxk2Y6m4h+pgLNv1QhltgUdDyTxXLyl5Pfzd7+NGVmlLIosYzl7e8Q2gKIl/Zx2/5lw=="}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:22.756790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-7a12f4d1-f8f6-49a7-bb38-67a44d42e32b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'key_pairs'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:22.774852 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-7a12f4d1-f8f6-49a7-bb38-67a44d42e32b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for user 3d3896bd70dd43fe95f7125f9f4693a0 and project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'key_pairs'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:22.953549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7a12f4d1-f8f6-49a7-bb38-67a44d42e32b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.884214 Jun 06 20:42:22.954451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 21/39] 10.222.0.41 () {62 vars in 1199 bytes} [Mon Jun 6 20:42:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 886 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 20:42:22.963805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:22.976494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d0b039a1-3ab3-4a78-960e-b8f44feaeee9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.755938 Jun 06 20:42:22.979013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 19/40] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:22 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:23.995112 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:23.996535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:24.013119 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:24.014985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:24.017422 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:24.022062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:24.300156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-282373644", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:24.534563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] validate_networks() for [('3e6c1431-6421-49ec-9458-fa7de78be53c', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:42:25.470384 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:25.511016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8616df8b-912f-4d1c-8a30-43d8a51fc47e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 1.512361 Jun 06 20:42:25.520536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 20/41] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:23 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:26.384561 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-68cdd062-27f5-4892-b3b6-131b4e265799 req-6405847f-886b-4f90-9694-6847ac982a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7277dc44-caaa-4b10-b713-316c31209aa4", "tag": "c6079a99-c9ad-4a0b-9dc8-f6c46c857623"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:26.428409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-68cdd062-27f5-4892-b3b6-131b4e265799 req-6405847f-886b-4f90-9694-6847ac982a96 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:26.429749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-68cdd062-27f5-4892-b3b6-131b4e265799 req-6405847f-886b-4f90-9694-6847ac982a96 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:26.523869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-68cdd062-27f5-4892-b3b6-131b4e265799 req-6405847f-886b-4f90-9694-6847ac982a96 service nova] Creating event network-changed:c6079a99-c9ad-4a0b-9dc8-f6c46c857623 for instance 7277dc44-caaa-4b10-b713-316c31209aa4 on hv-cinder-84487 Jun 06 20:42:26.528434 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-68cdd062-27f5-4892-b3b6-131b4e265799 req-6405847f-886b-4f90-9694-6847ac982a96 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124579) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 20:42:26.529934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:26.543529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:26.545381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:26.546937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:26.604175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.compute.rpcapi [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 20:42:26.607924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=124579) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 20:42:26.675335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1703142d-7568-45ad-9817-4425779b2cd1 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.102294 Jun 06 20:42:26.676063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 21/42] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:26.697916 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:26.698684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:26.733300 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:26.733773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:26.739457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:26.739947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:27.533542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:27.574016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4c4600cb-d007-4d4e-8663-edc1f8428512 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.879711 Jun 06 20:42:27.581287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 22/43] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:26 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:28.456222 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-44237986-8648-4f66-bec2-757aceefaec8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: .version_select at 0x7fdaeae973a0>, body: {"keypair": {"name": "tempest-keypair-1395729434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJjb+ubjpPa5j4K61HkNHQZxFCknMq7lNGumu1XHQ1oB7xZo1h600ddKBTNHxiBnYxxD4ZTunPUvF+9aNbIkKY0BwfaW6D8/n54ldc3lbVGLqk6/PYTXsYcv3aidF0kdg=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:28.528507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:42:28.529340 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:42:28.529991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:42:28.530895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:42:28.531463 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:42:28.531571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-44237986-8648-4f66-bec2-757aceefaec8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for project 3a1af880b45d426aa752589183354a77. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:28.538697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-44237986-8648-4f66-bec2-757aceefaec8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for user a47ab3ebbc9a4a429e5df2a616f305f0 and project 3a1af880b45d426aa752589183354a77. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:28.565004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:28.567854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:28.572195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:28.574180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:28.645383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:28.657307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for user a10ffb60631240fdb6b4a69d6d7f73e2 and project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:28.685112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:42:28.689179 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:42:28.690330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-44237986-8648-4f66-bec2-757aceefaec8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.107667 Jun 06 20:42:28.690939 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:42:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:28.698769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:28.706634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:28.730155 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:28.730616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:28.731417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:28.736934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:28.930679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b8dd3284-53ae-451a-af49-8997a2ad11df tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.468887 Jun 06 20:42:28.937469 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:42:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 5476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:42:28.942983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5c8cd422-dc5d-4f2c-8d72-1dc0b4e25549 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:28.943877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5c8cd422-dc5d-4f2c-8d72-1dc0b4e25549 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:29.085563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5c8cd422-dc5d-4f2c-8d72-1dc0b4e25549 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:29.104009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5c8cd422-dc5d-4f2c-8d72-1dc0b4e25549 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1221 microversion: 2.1 time: 0.164949 Jun 06 20:42:29.107199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 23/46] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:28 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:29.666190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-897546712", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:29.824082 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] validate_networks() for [('3e6c1431-6421-49ec-9458-fa7de78be53c', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:42:29.936221 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:29.953984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e5b7b911-a06a-4d8d-ab9b-50a19068222a tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 1.261638 Jun 06 20:42:29.968005 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 24/47] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:28 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:30.977731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:30.979857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:31.001464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:31.002820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:31.007174 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:31.009799 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:31.259291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:42:31.259910 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:42:31.260360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:42:31.261434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:42:31.261954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:42:31.289032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:31.292434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:31.306921 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:31.308234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:31.404503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:31.419864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for user a10ffb60631240fdb6b4a69d6d7f73e2 and project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:31.468197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:42:31.478275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:42:31.742050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-eeda2831-4fcf-4c1e-b31b-3045a7922403 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.080039 Jun 06 20:42:31.747328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 24/48] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:42:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:42:31.770579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:31.786455 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9c55404d-6f23-4cc7-92e6-27f7ca54a334 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.813578 Jun 06 20:42:31.786578 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 25/49] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:30 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:31.809803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-95875e82-32fe-4df7-a34f-7916a81a94d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:31.815843 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-95875e82-32fe-4df7-a34f-7916a81a94d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:32.090650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-95875e82-32fe-4df7-a34f-7916a81a94d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:32.120836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-95875e82-32fe-4df7-a34f-7916a81a94d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1221 microversion: 2.1 time: 0.362389 Jun 06 20:42:32.124547 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 25/50] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:31 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1221 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:32.775641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2061605303", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46b99f10-fa03-4d68-918b-dec225733498"}], "security_groups": [{"name": "tempest-securitygroup--1579471120"}], "key_name": "tempest-keypair-1109419621", "user_data": "}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:32.800753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:32.801507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:32.818938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:32.818938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:32.818938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:32.818938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:33.023424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] validate_networks() for [('46b99f10-fa03-4d68-918b-dec225733498', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:42:33.394136 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:33.407868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3602a1b8-4b91-49f8-a3a6-278327cc8bd4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.611254 Jun 06 20:42:33.412949 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 26/51] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:32 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:33.420031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:33.420854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:33.430639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:33.431180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:33.432561 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:33.433251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:33.593070 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:33.609315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-20bf4379-8582-4993-95fc-90f3264d7f57 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1225 microversion: 2.1 time: 0.194287 Jun 06 20:42:33.619025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 27/52] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:33 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:34.063967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:42:34.064488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:42:34.064865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:42:34.065283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:42:34.065706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:42:34.078728 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.079811 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.080797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.081387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.102811 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:34.114931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for user 3d3896bd70dd43fe95f7125f9f4693a0 and project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:34.168179 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:42:34.170699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:42:34.428370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:34.429177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:34.439609 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.440088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.447799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.447799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.457656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ff456a4d-1540-46ff-8d35-774570fcf7a0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.706826 Jun 06 20:42:34.470711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 26/53] 10.222.0.41 () {62 vars in 1187 bytes} [Mon Jun 6 20:42:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 20:42:34.480080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:34.484099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:34.597343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:34.614299 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:34.614299 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:34.614299 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6a9c6154-5ae8-4055-8ae7-9390e4a3710a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1282 microversion: 2.20 time: 0.137414 Jun 06 20:42:34.616659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 27/54] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:34 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:34.627824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:34.629278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:34.640600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.641351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.644898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:34.645591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:34.737035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:34.754112 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0b2f4200-fc43-4ad0-83c1-ddf5ea36aead tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1217 microversion: 2.1 time: 0.130986 Jun 06 20:42:34.766434 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 28/55] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:34 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:34.965887 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:34.997371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-91d90b57-c60e-4b53-b2d2-57c2a0139df9 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.570035 Jun 06 20:42:34.998151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 28/56] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:34 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:35.628866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:35.629477 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:35.631446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:35.651932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1039182401", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbae566b-f7e0-4501-b7f1-3ce574ab7b06"}], "security_groups": [{"name": "tempest-securitygroup--2119210804"}], "key_name": "tempest-keypair-1395729434", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:35.662010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:35.715451 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:35.723380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:35.730467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:35.732589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5c18ba76-570c-44e7-bb6a-4a9af5b140c6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1282 microversion: 2.20 time: 0.107605 Jun 06 20:42:35.735271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 29/57] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:35 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:35.775184 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:35.776197 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:35.798469 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:35.798940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:35.800097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:35.800593 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:35.809682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=69 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:35.842214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] validate_networks() for [('bbae566b-f7e0-4501-b7f1-3ce574ab7b06', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:42:35.908641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:35.920638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fd924f4c-d6f5-4ded-9f7e-6f4dc7bb45e2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1273 microversion: 2.1 time: 0.147173 Jun 06 20:42:35.923072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 30/58] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:35 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:36.019036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:36.020026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:36.032211 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.038519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.038519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.038519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.276660 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:36.290474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9e3fa447-9ec2-441f-ad41-4a437a732fae tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.275911 Jun 06 20:42:36.291181 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 31/59] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:36 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:36.754831 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:36.762941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:36.779468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.779468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.779468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.779468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.863531 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:42:36.868072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:42:36.868072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:42:36.868072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:42:36.868072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:42:36.878288 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.879097 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.880407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.880994 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.881935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:36.894004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=35 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:36.900714 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:36.903871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for project 3a1af880b45d426aa752589183354a77. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:42:36.904862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:36.908398 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for user a47ab3ebbc9a4a429e5df2a616f305f0 and project 3a1af880b45d426aa752589183354a77. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:42:36.909521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e45af469-7bac-4d2c-a3cb-9afd23175394 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1286 microversion: 2.20 time: 0.158030 Jun 06 20:42:36.912392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 32/60] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:36 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:36.926783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:42:36.929117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:42:36.938694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:36.939897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:36.951019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.952577 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:36.954047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:36.957535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:37.047983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:37.055342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d040f566-b733-4cc6-8146-1ea4e1b4d551 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1273 microversion: 2.1 time: 0.120970 Jun 06 20:42:37.055973 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 33/61] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:36 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:37.139657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-89e64cb9-4f1e-429b-92f2-6169a93fc3ca tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.493609 Jun 06 20:42:37.140307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 29/62] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:42:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:42:37.152587 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fae30f0c-f60b-4159-9d5c-16dc6aaef76b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:37.153185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fae30f0c-f60b-4159-9d5c-16dc6aaef76b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:37.220701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fae30f0c-f60b-4159-9d5c-16dc6aaef76b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:37.245965 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fae30f0c-f60b-4159-9d5c-16dc6aaef76b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1238 microversion: 2.1 time: 0.096338 Jun 06 20:42:37.245965 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 34/63] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:37 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:37.308715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:37.309591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:37.321378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:37.321996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:37.322953 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:37.324008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:37.475250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:37.483209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fe88d983-1f5c-4229-8194-84ecbd6cfbfb tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.179523 Jun 06 20:42:37.483996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 30/64] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:37 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:37.930952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:37.931578 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:37.947145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:37.949999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:37.950929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:37.951482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:38.076939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:38.077897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:38.089756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:38.090212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:38.090996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:38.098756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:38.186045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.197906 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.202044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.203638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2112a6ff-3fdf-4a58-a1c6-cb5e63287fa3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1286 microversion: 2.20 time: 0.278342 Jun 06 20:42:38.208907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 35/65] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:37 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1286 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:38.262098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1eaaa65a-7c80-4cf5-9cbc-28e0135e1fc0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:38.262736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1eaaa65a-7c80-4cf5-9cbc-28e0135e1fc0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:38.365957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1eaaa65a-7c80-4cf5-9cbc-28e0135e1fc0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.374109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1eaaa65a-7c80-4cf5-9cbc-28e0135e1fc0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1238 microversion: 2.1 time: 0.116241 Jun 06 20:42:38.374684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 36/66] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:38 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:38.453543 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.464433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e8870b1d-1ece-47d5-b0ec-c97afca83100 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1281 microversion: 2.1 time: 0.392547 Jun 06 20:42:38.466204 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 31/67] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:38 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:38.501223 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:38.502140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:38.514432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:38.514432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:38.515449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:38.515923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:38.701521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:38.711809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-832ea8c2-5bd7-436f-b0d9-8514cc8a6790 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.214027 Jun 06 20:42:38.712685 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 37/68] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:38 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:39.235699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:39.235699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:39.241491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.249747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.250923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.270175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.391634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:39.392879 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:39.403641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.409216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.409355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.409707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.493306 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:39.528192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:39.535741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:39.547640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c59bc1a6-d9ae-47ff-bb16-1259decd3d98 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1352 microversion: 2.20 time: 0.325922 Jun 06 20:42:39.555120 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 32/69] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:39 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1352 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:39.563358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:39.564189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:39.570637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.571361 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.574918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.575584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.689987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:39.696404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:39.717473 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-812405d9-4284-4f1b-a1e6-be888876d0f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1234 microversion: 2.1 time: 0.329641 Jun 06 20:42:39.718080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 38/70] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:39 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1234 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:39.720328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c2da396b-4559-40af-aba6-356a35a69e94 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1279 microversion: 2.1 time: 0.161243 Jun 06 20:42:39.720901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 33/71] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:39 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:39.732798 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:39.734624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:39.752605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.759099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:39.762076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:39.763964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.171933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-95e38156-246d-42d8-bbe2-85b09c0454d5 req-8b6e942b-55e2-4753-83b0-d98b357aa6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8acd09-79a4-423a-9e5b-91aff7b7fce8", "tag": "013be499-39fe-4107-8a50-02caa10510df"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:40.205846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-95e38156-246d-42d8-bbe2-85b09c0454d5 req-8b6e942b-55e2-4753-83b0-d98b357aa6ba service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.206293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-95e38156-246d-42d8-bbe2-85b09c0454d5 req-8b6e942b-55e2-4753-83b0-d98b357aa6ba service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.293855 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-95e38156-246d-42d8-bbe2-85b09c0454d5 req-8b6e942b-55e2-4753-83b0-d98b357aa6ba service nova] Creating event network-changed:013be499-39fe-4107-8a50-02caa10510df for instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 on hv-cinder-84487 Jun 06 20:42:40.294399 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-95e38156-246d-42d8-bbe2-85b09c0454d5 req-8b6e942b-55e2-4753-83b0-d98b357aa6ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=124578) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 20:42:40.295517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.296290 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.297310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.300046 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.301889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:40.316979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2b069538-826a-4f23-b673-cf3d0b39d7af tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.590097 Jun 06 20:42:40.320284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 39/72] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:39 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:40.330344 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.compute.rpcapi [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 20:42:40.331401 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] Releasing lock "compute-rpcapi-router" {{(pid=124578) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 20:42:40.377488 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9b025693-f71e-4cf5-89ce-f5064d631ce0 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210068 Jun 06 20:42:40.378683 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 34/73] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:40.568280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:40.569064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:40.591585 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.596192 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.601517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.603062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.734856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:40.735836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:40.755760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.756454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.757429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.758190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.806077 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:40.824557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:40.827167 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:40.830349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-578ed92d-b5cc-4ff5-b1cb-69b3325fcb54 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1340 microversion: 2.20 time: 0.267627 Jun 06 20:42:40.830920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 40/74] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:40 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:40.846109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:40.846912 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:40.853236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.853630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:40.854592 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:40.855195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:41.122180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:41.134028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-51b85b8a-565b-404f-b122-a7c596f4e1a4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1308 microversion: 2.1 time: 0.403305 Jun 06 20:42:41.135338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 35/75] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:40 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:41.315845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-af0f188e-55d7-4120-9ff4-4219ff233321 req-720dc180-9d86-4c10-9884-f3b104c53df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7277dc44-caaa-4b10-b713-316c31209aa4", "name": "network-vif-plugged", "status": "completed", "tag": "c6079a99-c9ad-4a0b-9dc8-f6c46c857623"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:41.325501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-af0f188e-55d7-4120-9ff4-4219ff233321 req-720dc180-9d86-4c10-9884-f3b104c53df0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:41.326247 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-af0f188e-55d7-4120-9ff4-4219ff233321 req-720dc180-9d86-4c10-9884-f3b104c53df0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:41.341907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-af0f188e-55d7-4120-9ff4-4219ff233321 req-720dc180-9d86-4c10-9884-f3b104c53df0 service nova] Creating event network-vif-plugged:c6079a99-c9ad-4a0b-9dc8-f6c46c857623 for instance 7277dc44-caaa-4b10-b713-316c31209aa4 on hv-cinder-84487 Jun 06 20:42:41.343958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:41.348848 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-af0f188e-55d7-4120-9ff4-4219ff233321 req-720dc180-9d86-4c10-9884-f3b104c53df0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175992 Jun 06 20:42:41.355610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 36/76] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:41.356198 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1b1434dc-1ef6-4525-9a9e-9de530653773 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.510033 Jun 06 20:42:41.356198 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 41/77] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:40 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:41.358999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:41.360038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:41.368596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:41.369106 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:41.370614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:41.371302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:41.848229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:41.849348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:41.857575 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:41.858017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:41.858786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:41.859214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:42.063837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.077623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.085344 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.088160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.089786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-55983d9e-f88a-4677-914c-bd2f034ae604 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.245357 Jun 06 20:42:42.093446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 42/78] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:41 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:42.109980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7aa609e6-796c-4dc2-b34c-c6b65113711e tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.758547 Jun 06 20:42:42.110567 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 37/79] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:41 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:42.158267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:42.158961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:42.181298 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:42.181754 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:42.183116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:42.183678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:42.291572 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.305924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8da6002e-a2ce-44fc-96ef-0d87621f02e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1296 microversion: 2.1 time: 0.152228 Jun 06 20:42:42.316669 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 43/80] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:42 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:42.370582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:42.371206 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:42.377688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:42.378175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:42.378959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:42.379624 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:42.590907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:42.598429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-241b3e5c-47c3-4eef-b1ab-a9119b2e7895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.232198 Jun 06 20:42:42.599231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 38/81] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:42 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:43.112489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:43.113255 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:43.126852 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:43.127458 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:43.128796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.129251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.137080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.137614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.138065 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.138836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.139262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.141185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.707145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:43.717700 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7032d2d9-52b7-4b59-b2e8-7cea6e12ba82 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1315 microversion: 2.1 time: 0.594452 Jun 06 20:42:43.718287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 39/82] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:43 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:43.736034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-8f763b9a-d00d-4e21-b1e9-7227a95db1cb req-2799106e-8599-40bf-90f1-fd7524d890b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a1e290-4870-4dff-a043-14915d563e75", "tag": "dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:43.746932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8f763b9a-d00d-4e21-b1e9-7227a95db1cb req-2799106e-8599-40bf-90f1-fd7524d890b7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.747649 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8f763b9a-d00d-4e21-b1e9-7227a95db1cb req-2799106e-8599-40bf-90f1-fd7524d890b7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.763246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-8f763b9a-d00d-4e21-b1e9-7227a95db1cb req-2799106e-8599-40bf-90f1-fd7524d890b7 service nova] Creating event network-changed:dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601 for instance 43a1e290-4870-4dff-a043-14915d563e75 on hv-cinder-84487 Jun 06 20:42:43.770282 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-8f763b9a-d00d-4e21-b1e9-7227a95db1cb req-2799106e-8599-40bf-90f1-fd7524d890b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050094 Jun 06 20:42:43.771235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 40/83] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:43.777963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:43.779300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:43.787769 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.788331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.789509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.790153 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.846273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:43.857706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:43.859881 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:43.861509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b5b50899-88ed-44d3-914d-f06b0538fb2e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.754873 Jun 06 20:42:43.874872 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 44/84] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:43 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:43.880191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:43.881082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:43.888221 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.888930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:43.889903 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:43.890530 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:44.093657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:44.172698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:44.184991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-43936467-2b8e-4396-b2f2-5b8a39af2bab tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.308267 Jun 06 20:42:44.187735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 45/85] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:43 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:44.189853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:44.198578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-10535a9e-f45e-45df-b823-4de01bdbe1c1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.424399 Jun 06 20:42:44.199314 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 41/86] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:43 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:44.740728 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:44.741529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:44.751853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:44.756097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:44.759251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:44.761256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:44.887162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:44.888091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:44.897885 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:44.898627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:44.899916 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:44.900562 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.133348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.168996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b092868e-3188-4589-bc82-2e9ab8efb8ec tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1503 microversion: 2.1 time: 0.434247 Jun 06 20:42:45.169918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 46/87] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:44 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:45.218772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:45.225412 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:45.243810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:45.245970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.247107 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:45.248138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.437153 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.445990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.450898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.459497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f8f972a2-1133-408e-96c0-2c16ca22a35e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.582716 Jun 06 20:42:45.460451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 42/88] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:44 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:45.465828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:45.466652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:45.473245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:45.474021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.475019 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:45.475737 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.741386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.751705 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f9953b15-2329-4a24-ad98-6d90729b9ad1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.290137 Jun 06 20:42:45.754591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 43/89] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:45 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:45.769117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:45.779837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-312906c2-190e-43af-8213-3064bf1d3992 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.569304 Jun 06 20:42:45.780425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 47/90] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:45 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:45.886474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-4b46cdab-d886-4814-b04a-a0db20693941 req-82b88c6c-bd15-4ae8-9b24-dea29cfdf5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cd0208-5f22-427d-95a0-100597554481", "tag": "0fccccb6-9c44-4b23-8b78-dc4ba9b583dd"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:45.898494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-4b46cdab-d886-4814-b04a-a0db20693941 req-82b88c6c-bd15-4ae8-9b24-dea29cfdf5a1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:45.902698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-4b46cdab-d886-4814-b04a-a0db20693941 req-82b88c6c-bd15-4ae8-9b24-dea29cfdf5a1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:45.916460 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-4b46cdab-d886-4814-b04a-a0db20693941 req-82b88c6c-bd15-4ae8-9b24-dea29cfdf5a1 service nova] Creating event network-changed:0fccccb6-9c44-4b23-8b78-dc4ba9b583dd for instance 46cd0208-5f22-427d-95a0-100597554481 on hv-cinder-84487 Jun 06 20:42:45.924311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-4b46cdab-d886-4814-b04a-a0db20693941 req-82b88c6c-bd15-4ae8-9b24-dea29cfdf5a1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041808 Jun 06 20:42:45.931777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 48/91] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:46.126930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-c2bd7c64-21a6-4abd-aacc-4c626eea675e req-74f55206-bcf4-49a3-b4e5-11c52b2eb0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:46.139587 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-c2bd7c64-21a6-4abd-aacc-4c626eea675e req-74f55206-bcf4-49a3-b4e5-11c52b2eb0cc service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.140065 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-c2bd7c64-21a6-4abd-aacc-4c626eea675e req-74f55206-bcf4-49a3-b4e5-11c52b2eb0cc service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.157460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-c2bd7c64-21a6-4abd-aacc-4c626eea675e req-74f55206-bcf4-49a3-b4e5-11c52b2eb0cc service nova] Creating event network-changed:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:42:46.163355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-c2bd7c64-21a6-4abd-aacc-4c626eea675e req-74f55206-bcf4-49a3-b4e5-11c52b2eb0cc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408111 Jun 06 20:42:46.169836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 44/92] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:46.481118 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:46.482514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:46.490464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.493297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.494281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.497679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.518850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:46.771188 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:46.775115 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:46.788641 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.789313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.790335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.791226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.804642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:46.814215 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:46.815999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:46.817260 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-72cb75f0-8897-4143-8a26-cb6065fa66db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.342863 Jun 06 20:42:46.825332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 49/93] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:46 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:46.825332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:46.825332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:46.832572 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.833018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.833780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:46.834293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:46.920091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=26 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:46.982427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:46.991527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c6075ce2-668e-40b2-8268-35e71443fb9e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.224807 Jun 06 20:42:46.992663 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 45/94] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:46 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:47.237920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:47.261038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7f3851f3-2541-44cf-a9e2-c8e9d99f5662 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.438561 Jun 06 20:42:47.261652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 50/95] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:46 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:47.348610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "512dbb4d-a4f6-4409-9129-b3160a297d19"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:47.349767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:47.356400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:47.356846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:47.357621 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:47.358062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:47.835548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:47.839091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:47.852623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:47.863185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:47.867432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:47.868455 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.224924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:48.239891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:48.247644 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:48.250054 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fae7fd07-1a3a-4849-94bc-3a56d4b7c804 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.418357 Jun 06 20:42:48.252473 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 51/96] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:47 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:48.259722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-00fe5199-4908-4023-b028-79206c651c9e req-8a54845d-294e-4b1d-ab64-c474d24567b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8acd09-79a4-423a-9e5b-91aff7b7fce8", "name": "network-vif-plugged", "status": "completed", "tag": "013be499-39fe-4107-8a50-02caa10510df"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:48.270336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-00fe5199-4908-4023-b028-79206c651c9e req-8a54845d-294e-4b1d-ab64-c474d24567b0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:48.274254 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-00fe5199-4908-4023-b028-79206c651c9e req-8a54845d-294e-4b1d-ab64-c474d24567b0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.286122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-00fe5199-4908-4023-b028-79206c651c9e req-8a54845d-294e-4b1d-ab64-c474d24567b0 service nova] Creating event network-vif-plugged:013be499-39fe-4107-8a50-02caa10510df for instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 on hv-cinder-84487 Jun 06 20:42:48.294651 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-00fe5199-4908-4023-b028-79206c651c9e req-8a54845d-294e-4b1d-ab64-c474d24567b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040490 Jun 06 20:42:48.296264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 52/97] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:48.304080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:48.305171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:48.315763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:48.317770 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.319107 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:48.319742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.379277 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=18 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:48.645949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:48.692384 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5ddc7e3b-8a08-4dc4-8825-f8eb05183291 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.380267 Jun 06 20:42:48.701622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 53/98] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:48 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:48.718468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:48.721343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:48.749642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:48.750268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.751226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:48.751871 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:48.840500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9b5d08f9-9886-4c42-851a-526b91541b0d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "POST /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.490627 Jun 06 20:42:48.845603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 46/99] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:42:47 2022] POST /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:48.996226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:49.003860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9ba114a7-30f3-464b-a336-796f236ab0ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.300698 Jun 06 20:42:49.004677 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 54/100] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:48 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:49.270604 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:49.271388 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:49.279131 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:49.279894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:49.280798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:49.281607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:49.313436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:49.449699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:49.460581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:49.462067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:49.463379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1213c8f7-f0da-4ff0-a175-504a0677fdfb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.198030 Jun 06 20:42:49.474412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 47/101] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:49 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:49.721955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:49.722739 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:49.737681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:49.738323 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:49.739287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:49.739949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:49.914003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:49.924953 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ea632b7c-c295-4ce0-9ad1-8e63223057e6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.206811 Jun 06 20:42:49.927630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 55/102] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:49 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:50.022936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:50.023685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:50.029926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.030420 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:50.031201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.031642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:50.202034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:50.211088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-692a18ea-ec11-437a-b8d1-970ae84f389e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.192997 Jun 06 20:42:50.212063 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 48/103] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:50 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:50.482105 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:50.482710 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:50.489615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.490216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:50.491140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.491571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:50.637435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:50.652656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:50.654280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:50.655409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-44a8723a-deba-47f1-bf99-1680371d33fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.177854 Jun 06 20:42:50.656307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 56/104] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:50 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:50.946426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:50.947309 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:50.950767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=8 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:50.958945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.959404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:50.960226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:50.960668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:51.095864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:51.108957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7803d56e-1b1c-4941-a402-8a9d7061306f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.166677 Jun 06 20:42:51.108957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 49/105] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:50 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:51.229269 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:51.230151 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:51.239646 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:51.242306 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:51.246438 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:51.246972 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:51.391651 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:51.400476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d8f47cfa-fd92-496e-bb9e-744761568e20 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.176615 Jun 06 20:42:51.401072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 57/106] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:51 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:51.673399 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:51.674027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:51.679995 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:51.680593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:51.681207 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:51.681646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:51.838909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:51.838909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:51.839565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:51.840104 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-66583ffc-f3a1-4f61-a472-af7ff56c1fa7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.170517 Jun 06 20:42:51.842807 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 50/107] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:51 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:52.028003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-b0727eed-24f7-4ba9-bfa4-d31a9d14d460 req-79b91d47-ed85-443c-86b3-74289a4bfb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a1e290-4870-4dff-a043-14915d563e75", "name": "network-vif-plugged", "status": "completed", "tag": "dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:52.028003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b0727eed-24f7-4ba9-bfa4-d31a9d14d460 req-79b91d47-ed85-443c-86b3-74289a4bfb1b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.028003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b0727eed-24f7-4ba9-bfa4-d31a9d14d460 req-79b91d47-ed85-443c-86b3-74289a4bfb1b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.028003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-b0727eed-24f7-4ba9-bfa4-d31a9d14d460 req-79b91d47-ed85-443c-86b3-74289a4bfb1b service nova] Creating event network-vif-plugged:dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601 for instance 43a1e290-4870-4dff-a043-14915d563e75 on hv-cinder-84487 Jun 06 20:42:52.033064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-b0727eed-24f7-4ba9-bfa4-d31a9d14d460 req-79b91d47-ed85-443c-86b3-74289a4bfb1b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Jun 06 20:42:52.033713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 58/108] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:52.278460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:52.278460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:52.278460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.278460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.279969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.279969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.279969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:52.280210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-91be58c5-47de-43da-a013-7b0be5c40f14 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.146108 Jun 06 20:42:52.280210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 51/109] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:52 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:52.417104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:52.417814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:52.424195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.424650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.425423 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.425862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.614182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:52.614182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1fea9ff7-1bdd-4b9f-8d60-509d95d6684f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.171480 Jun 06 20:42:52.614182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 59/110] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:52 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:52.859478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:52.860116 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:52.866148 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.866593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:52.867347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:52.867810 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:53.015749 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:53.024009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:53.025459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:53.027148 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-833a9320-08fd-45fe-819b-df3a2f606821 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.171494 Jun 06 20:42:53.027724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 52/111] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:52 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:53.283488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:53.284104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:53.290673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:53.291155 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:53.292125 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:53.294635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:53.468654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:53.477917 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-95716881-b68a-48da-b055-643430c165fd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.198621 Jun 06 20:42:53.488836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 60/112] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:53 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:53.607255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:53.607255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:53.617407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:53.618256 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:53.620429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:53.621268 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:53.784027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:53.797534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-525b1715-e5cf-40ab-a44a-1679ec9df8e0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.198604 Jun 06 20:42:53.798342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 53/113] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:53 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:54.045068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:54.056878 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-03263e9b-7dae-479e-80c9-90368d891c0a req-fc5eebc8-f86c-4f87-8d74-d271e49ac135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "name": "network-vif-plugged", "status": "completed", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:54.057010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:54.065503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-03263e9b-7dae-479e-80c9-90368d891c0a req-fc5eebc8-f86c-4f87-8d74-d271e49ac135 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.067875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.068548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.069229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-03263e9b-7dae-479e-80c9-90368d891c0a req-fc5eebc8-f86c-4f87-8d74-d271e49ac135 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.073110 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.073725 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.089915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-03263e9b-7dae-479e-80c9-90368d891c0a req-fc5eebc8-f86c-4f87-8d74-d271e49ac135 service nova] Creating event network-vif-plugged:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:42:54.095342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-03263e9b-7dae-479e-80c9-90368d891c0a req-fc5eebc8-f86c-4f87-8d74-d271e49ac135 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048350 Jun 06 20:42:54.096125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 54/114] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:42:54.220864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:54.229780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:54.231436 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:54.232767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dccb7c66-9e04-4e69-91d7-917206264496 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.191547 Jun 06 20:42:54.243830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 61/115] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:54 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:54.496777 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:54.497553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:54.504646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.505298 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.506450 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.507231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.696426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:54.704124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ef64b4d0-3fc3-4945-a55d-12702a7612b6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.212708 Jun 06 20:42:54.704685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 55/116] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:54 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:54.816814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:54.817432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:54.823931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.824384 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.825166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:54.825634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:54.973452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:54.982079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d373ecd0-c8ea-4f1d-ac8b-486846406f45 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1321 microversion: 2.1 time: 0.171419 Jun 06 20:42:54.982746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 62/117] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:54 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:55.254039 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:55.254753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:55.260897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:55.261404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:55.262639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:55.263193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:55.419017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:55.429946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:55.431517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:55.432878 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6ea198b3-9a06-497a-a53d-cf352e83c955 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.183765 Jun 06 20:42:55.433435 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 56/118] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:55 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:55.720645 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:55.721463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:55.727871 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:55.728321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:55.729085 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:55.729515 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:55.900768 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:55.911191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d6ace1aa-0f8d-4226-ae07-c75bcc1e00d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.194436 Jun 06 20:42:55.912600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 63/119] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:55 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:56.008286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:56.009004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:56.016384 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.016834 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.018266 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.018861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.114122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-448c1997-db6b-4803-b0af-9aa504d41cc9 req-8e04bc63-4e17-41ca-a889-76dfc37c3a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cd0208-5f22-427d-95a0-100597554481", "name": "network-vif-plugged", "status": "completed", "tag": "0fccccb6-9c44-4b23-8b78-dc4ba9b583dd"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:56.123985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-448c1997-db6b-4803-b0af-9aa504d41cc9 req-8e04bc63-4e17-41ca-a889-76dfc37c3a9a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.126230 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-448c1997-db6b-4803-b0af-9aa504d41cc9 req-8e04bc63-4e17-41ca-a889-76dfc37c3a9a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.136692 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-448c1997-db6b-4803-b0af-9aa504d41cc9 req-8e04bc63-4e17-41ca-a889-76dfc37c3a9a service nova] Creating event network-vif-plugged:0fccccb6-9c44-4b23-8b78-dc4ba9b583dd for instance 46cd0208-5f22-427d-95a0-100597554481 on hv-cinder-84487 Jun 06 20:42:56.142184 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-448c1997-db6b-4803-b0af-9aa504d41cc9 req-8e04bc63-4e17-41ca-a889-76dfc37c3a9a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Jun 06 20:42:56.143086 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 64/120] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:42:56.157649 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:56.166763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d18495e1-6fe4-4f71-9431-cd2feaea5efe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1514 microversion: 2.1 time: 0.163796 Jun 06 20:42:56.167348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 57/121] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:56 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:56.186705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:42:56.187978 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:56.194848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.195637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.196550 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.196940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.272123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'flavor' on Instance uuid 43a1e290-4870-4dff-a043-14915d563e75 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:42:56.450876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:56.451654 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:56.457901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.458348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.459118 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.459554 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.600051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:56.603160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c7cc9497-1163-4b99-81b9-b0868eac8634 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75/action" status: 200 len: 32 microversion: 2.1 time: 0.422751 Jun 06 20:42:56.604628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 65/122] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:42:56 2022] POST /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:42:56.614005 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:56.615715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:56.616954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b9ab8358-83e0-490c-a9d8-d5a9cbdefb64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.170036 Jun 06 20:42:56.627210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 58/123] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:56 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:56.627414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:56.627414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:56.632156 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.632611 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.633389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.633925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.636767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:42:56.784325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:56.793834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-76f9272b-f30e-460b-a557-79eba36aec46 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.183837 Jun 06 20:42:56.794426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 66/124] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:56 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:42:56.930387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:56.932047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:56.938295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.939144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:56.940871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:56.941719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:57.113696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:57.121957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0345cba6-aa6d-40f9-ab3e-bed5b558f79c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.195571 Jun 06 20:42:57.122548 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 59/125] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:56 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:57.635554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:57.636112 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:57.643283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:57.651649 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:57.651649 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:57.651649 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:57.782008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:57.790814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:57.792583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:57.793985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-028d24dd-b871-45ad-a4a0-99465e4ffaf3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.162867 Jun 06 20:42:57.794635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 67/126] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:57 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:42:57.810720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:57.812182 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:57.821295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:57.821764 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:57.823466 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:57.823587 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:57.959950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:57.970883 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1332de94-956c-49d9-9b3d-745b95ff4bb0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.163890 Jun 06 20:42:57.971473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 60/127] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:57 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:58.138901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:58.139607 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:58.146163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.146617 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:58.147401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.147898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:58.451835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:58.460703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-86d45058-8bf1-49e1-b907-a8cb635459ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.326152 Jun 06 20:42:58.461275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 68/128] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:58 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:58.814638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:58.816484 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:58.826747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.827801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:58.829122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.829787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:58.987955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:58.988559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:58.995111 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.995794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:58.996812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:58.997427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:59.006569 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:59.018159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:59.018321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:59.019449 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5e8e57f1-49d0-4a1f-b295-33a18bf38e0c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1408 microversion: 2.20 time: 0.210906 Jun 06 20:42:59.020184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 61/129] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:42:58 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:42:59.161557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:59.172272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2f1c7965-7e43-4472-971d-b7a7e6ff5cbb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.188619 Jun 06 20:42:59.187927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 69/130] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:58 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:42:59.487949 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:42:59.488988 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:42:59.498441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:59.501177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:59.501177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:42:59.501177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:42:59.733829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:42:59.741709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-584a0bc9-b969-42e5-af76-0c6d570a533a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.264918 Jun 06 20:42:59.742380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 62/131] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:42:59 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:00.049452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:00.050227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:00.056733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.057841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.059869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.060387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.208956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:00.210134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:00.218105 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:00.219029 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.220179 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.221403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.222178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.231806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:00.236777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:00.238779 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-da6a8842-acaa-4572-a80a-faa567deb7af tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1600 microversion: 2.20 time: 0.193598 Jun 06 20:43:00.242933 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 70/132] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:43:00 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1600 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:43:00.266409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:00.268219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:00.287587 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.288183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.289078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.290131 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.379388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b33a1466-c53a-4115-b071-c8286aa6c6cb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117269 Jun 06 20:43:00.380507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 71/133] 10.222.0.41 () {60 vars in 1315 bytes} [Mon Jun 6 20:43:00 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:43:00.459079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:00.479690 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9023da65-565e-4408-b4e0-e09cc7653176 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.278617 Jun 06 20:43:00.495346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 63/134] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:00 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:00.762264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:00.762771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:00.769391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.770079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:00.770914 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:00.771351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:01.467117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:01.481319 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4b42c8fc-4528-4403-ad49-0fbd603a46e4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.722337 Jun 06 20:43:01.483709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 72/135] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:00 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:01.498006 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:01.502950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:01.513858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:01.514529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:01.515463 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:01.516068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:01.760540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:01.764229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=100 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:01.770040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-59af7c51-c806-4f9a-9359-bc993b3cfcea tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.276546 Jun 06 20:43:01.782598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 64/136] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:01 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:02.261897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-d2526c1d-472e-459c-b4bb-6a8020185580 req-81b2009f-afa8-4eab-a086-c5f238e9e4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:43:02.272328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-d2526c1d-472e-459c-b4bb-6a8020185580 req-81b2009f-afa8-4eab-a086-c5f238e9e4f6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:02.272785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-d2526c1d-472e-459c-b4bb-6a8020185580 req-81b2009f-afa8-4eab-a086-c5f238e9e4f6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:02.295375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-d2526c1d-472e-459c-b4bb-6a8020185580 req-81b2009f-afa8-4eab-a086-c5f238e9e4f6 service nova] Creating event network-changed:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:43:02.301745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-d2526c1d-472e-459c-b4bb-6a8020185580 req-81b2009f-afa8-4eab-a086-c5f238e9e4f6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044088 Jun 06 20:43:02.303243 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 73/137] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:43:02.501715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:02.503041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:02.511762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:02.512864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:02.516022 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:02.516676 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:02.776280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:02.796583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:02.797865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:02.798908 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c9488d7b-e25e-40c1-a397-99c2736ae434 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.301090 Jun 06 20:43:02.801350 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 65/138] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:02 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:02.822661 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:02.823740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:02.828531 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:02.829300 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:02.999890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:03.007397 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4f61a708-5954-4d4f-b27e-5f2e6ddaf8d5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.220463 Jun 06 20:43:03.017526 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 74/139] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:02 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:03.816152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:03.817023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:03.824284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:03.826403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:03.828444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:03.829531 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:04.008310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:04.020135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-127a5635-595f-46d2-a2ed-2efed36f02d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.206986 Jun 06 20:43:04.021105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 66/140] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:03 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:04.026462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:04.027029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:04.034054 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:04.034765 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:04.035573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:04.036043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:04.200691 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:04.208979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7d721964-728e-49c9-960c-ad34e23ade31 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.187407 Jun 06 20:43:04.224056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 75/141] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:04 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:05.041862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:05.043078 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:05.054980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:05.055442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:05.056258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:05.057246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:05.206001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:05.214327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-587b0ee5-ca69-4154-a7d8-5969c07fa44c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.176368 Jun 06 20:43:05.214902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 67/142] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:05 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:05.229345 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:05.230181 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:05.235534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:05.247635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:05.247635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:05.247635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:05.247635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:05.444317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:05.451797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-684493c1-fada-4b4b-99a0-4f919a7ae328 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.227957 Jun 06 20:43:05.461067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 76/143] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:05 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:06.114600 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:06.115147 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:06.122208 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.123057 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.123507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.123969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.152421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:43:06.230709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:06.231922 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:06.239595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.240359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.241436 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.242166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.412641 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:06.455080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:06.464835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ef000ba9-27f3-437b-b6d6-19ad8b5c08ed tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1364 microversion: 2.1 time: 0.237547 Jun 06 20:43:06.467044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 77/144] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:06 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:06.476533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:06.477599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:06.489408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.491850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.491850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.492448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.511619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b07661c7-68bc-49ba-9675-0f2eae4bba6d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 204 len: 0 microversion: 2.1 time: 0.400786 Jun 06 20:43:06.512241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 68/145] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:43:06 2022] DELETE /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:43:06.525074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:06.525074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:06.540593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.541035 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.541824 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:06.542268 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:06.689497 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:06.697233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a3e30d02-8d4d-4e0e-af69-7a061dc8f6c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.228375 Jun 06 20:43:06.697904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 78/146] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:06 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:06.926564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:06.932383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-862b085a-b4af-49a6-bfff-e70f3beddf37 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.412889 Jun 06 20:43:06.932981 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 69/147] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:06 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:07.489682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:07.490590 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:07.500826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.501874 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.503881 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.504835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.717797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:07.718668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:07.727280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.728144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.729916 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.730532 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.788918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:07.800336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4b31a3f6-f541-4415-933b-ecb7b3d44271 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1550 microversion: 2.1 time: 0.316640 Jun 06 20:43:07.801305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 79/148] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:07 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1550 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:07.824738 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:07.825251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:07.831889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.832561 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.833488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.834177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.899167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:07.908753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-319e69f5-c5a9-4171-8679-ac9ac73e5ac1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.198095 Jun 06 20:43:07.909845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 70/149] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:07 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:07.928547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4f39a497-c167-441a-99f4-7bc5c41068a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107667 Jun 06 20:43:07.929471 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 80/150] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:43:07 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:43:07.953101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:07.953996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:07.961182 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.961873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:07.963770 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:07.964694 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:08.671143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:08.696140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7d40c22c-ff11-49e2-a055-0849f7fad866 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.746308 Jun 06 20:43:08.711694 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 71/151] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:07 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:08.939483 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:08.941426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:08.951523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:08.952301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:08.953230 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:08.953970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:09.205899 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:09.213967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5b833c1b-0225-4950-a93b-23838eee4b50 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.289896 Jun 06 20:43:09.214554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 81/152] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:08 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:09.722977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:09.724713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:09.735417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:09.735417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:09.735417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:09.735417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:09.937699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-518db200-c947-4d16-a8ee-7d08b6e96cfa req-05a6cfff-8931-4831-b559-3c45239d34eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cd0208-5f22-427d-95a0-100597554481", "tag": "0fccccb6-9c44-4b23-8b78-dc4ba9b583dd"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:43:09.951378 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-518db200-c947-4d16-a8ee-7d08b6e96cfa req-05a6cfff-8931-4831-b559-3c45239d34eb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:09.952130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-518db200-c947-4d16-a8ee-7d08b6e96cfa req-05a6cfff-8931-4831-b559-3c45239d34eb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:09.966995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-518db200-c947-4d16-a8ee-7d08b6e96cfa req-05a6cfff-8931-4831-b559-3c45239d34eb service nova] Creating event network-changed:0fccccb6-9c44-4b23-8b78-dc4ba9b583dd for instance 46cd0208-5f22-427d-95a0-100597554481 on hv-cinder-84487 Jun 06 20:43:09.968467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:09.972463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-518db200-c947-4d16-a8ee-7d08b6e96cfa req-05a6cfff-8931-4831-b559-3c45239d34eb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038431 Jun 06 20:43:09.974168 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 82/153] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:43:09.979889 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-aa9b4e95-0d62-4b26-85d9-363811ec6d7f tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.259979 Jun 06 20:43:09.982586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 72/154] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:09 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:10.232954 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:10.233861 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:10.240366 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:10.241022 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:10.241963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:10.242389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:10.398812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:10.409432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b1fdf487-c3c6-4afa-ba85-6320b9c79fb7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.181461 Jun 06 20:43:10.411748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 83/155] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:10 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:11.005574 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:11.008135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:11.018063 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:11.018659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:11.019588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:11.020214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:11.430509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:11.431702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:11.438087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:11.438533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:11.439775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:11.440100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:11.590794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:11.593879 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:11.601260 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-296776c7-5785-4dbe-9e40-52a53977c307 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.174965 Jun 06 20:43:11.602057 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 84/156] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:11 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:11.658286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:11.666460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-25678327-1e34-4538-be26-9ded6fe6a429 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.670003 Jun 06 20:43:11.667035 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 73/157] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:10 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:12.618759 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:12.619428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:12.625647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:12.626097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:12.626857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:12.627286 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:12.682791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:12.683413 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:12.690005 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:12.690674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:12.691438 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:12.692047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:12.770537 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:12.778654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a81e703d-f0e6-4d69-8a8c-c067497bd76e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.164133 Jun 06 20:43:12.779220 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 85/158] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:12 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:12.824479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:12.833273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3c807a07-be1b-4e3e-90a6-39f8094902f3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.153903 Jun 06 20:43:12.833524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 74/159] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:12 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:13.795680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:13.796315 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:13.802676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:13.803127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:13.803932 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:13.804374 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:13.853475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:13.856004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:13.870846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:13.871432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:13.872543 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:13.872986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:13.965827 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:13.976021 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-031e151f-7c2d-41f8-9b69-3c0d4873c577 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.184665 Jun 06 20:43:13.976931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 86/160] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:13 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:14.011169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:14.019321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1ecd5ced-a99d-4c0d-9c2f-5dddbed6c63d tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.170770 Jun 06 20:43:14.019918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 75/161] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:13 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:15.005207 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:15.005207 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:15.009191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:15.009965 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:15.012897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:15.014206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:15.037132 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:15.037902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:15.046403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:15.047190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:15.048234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:15.048874 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:15.352062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:15.359651 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-40b02042-3aab-461f-93a1-9f39f061d2d1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.363640 Jun 06 20:43:15.361720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:15.374610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 87/162] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:14 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:15.379513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-b79eeb29-c2c3-4d49-a937-191ee3fbe7d2 req-3b2d5af7-b837-4c84-8204-42c3b1ac1751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7277dc44-caaa-4b10-b713-316c31209aa4", "name": "network-vif-deleted", "tag": "c6079a99-c9ad-4a0b-9dc8-f6c46c857623"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:43:15.383876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fcc91ef1-ca7c-4686-8f39-22c08b4db6a3 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1555 microversion: 2.1 time: 0.343039 Jun 06 20:43:15.383876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 76/163] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:15 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1555 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:15.404014 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b79eeb29-c2c3-4d49-a937-191ee3fbe7d2 req-3b2d5af7-b837-4c84-8204-42c3b1ac1751 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:15.404829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b79eeb29-c2c3-4d49-a937-191ee3fbe7d2 req-3b2d5af7-b837-4c84-8204-42c3b1ac1751 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:15.423971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-b79eeb29-c2c3-4d49-a937-191ee3fbe7d2 req-3b2d5af7-b837-4c84-8204-42c3b1ac1751 service nova] Creating event network-vif-deleted:c6079a99-c9ad-4a0b-9dc8-f6c46c857623 for instance 7277dc44-caaa-4b10-b713-316c31209aa4 on hv-cinder-84487 Jun 06 20:43:15.432021 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-b79eeb29-c2c3-4d49-a937-191ee3fbe7d2 req-3b2d5af7-b837-4c84-8204-42c3b1ac1751 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058319 Jun 06 20:43:15.433609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 88/164] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:43:16.396653 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:16.397257 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:16.400959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:16.401676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:16.404423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:16.404945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:16.405699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:16.406142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:16.408099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:16.408360 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:16.409094 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:16.409932 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:16.444523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:16.444962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:16.445403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lazy-loading 'fault' on Instance uuid 7277dc44-caaa-4b10-b713-316c31209aa4 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:43:16.489653 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583c43bffb24329b5e06b1e749affd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baa5449b82446198b16e944162aa85b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:16.498469 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3797c58d-6c20-451a-ab68-e8421dad8467 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 200 len: 1351 microversion: 2.1 time: 0.101763 Jun 06 20:43:16.499038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 89/165] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:16 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:16.541130 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:16.550598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-35ac0c20-fcab-497d-bd36-f60b14204dd1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.158001 Jun 06 20:43:16.554319 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 77/166] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:16 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:17.518712 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:17.519517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:17.525792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.527036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.527851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.528279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.541597 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] HTTP exception thrown: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Request method failure captured: Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 HTTP/1.1 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmafHYvQiBgTUgSxbdk2QW1o3hNScrPkpBHiyisQkcE3Ab6Ym6-yLh-lmVHou2zv-OLzqyv56u8ToLsS7d0dBcmKq9Vv40BQY2boknGPVOmUnp-bS3RsCT2LP9IvvilUTx3B4oyXYLcydzNJc99FtdcCUktSC2ZqY9eJW-D8tuy1eT0 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:43:17.553482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7baa5449b82446198b16e944162aa85b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7baa5449b82446198b16e944162aa85b", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 9583c43bffb24329b5e06b1e749affd8 Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.554746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '7277dc44-caaa-4b10-b713-316c31209aa4'} Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:43:17.555498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.560407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.561548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Returning 404 to user: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:43:17.561548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e82d19ae-c683-4618-be93-eb9ecae083b4 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 404 len: 111 microversion: 2.1 time: 0.035033 Jun 06 20:43:17.561548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 90/167] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:17 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:43:17.568918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:17.569555 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:17.576344 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.577190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.578487 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.579101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.665681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:17.667279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:17.673729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.674266 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.675028 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:17.675611 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:17.691127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] HTTP exception thrown: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Request method failure captured: Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4/os-volume_attachments HTTP/1.1 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmafHYvQiBgTUgSxbdk2QW1o3hNScrPkpBHiyisQkcE3Ab6Ym6-yLh-lmVHou2zv-OLzqyv56u8ToLsS7d0dBcmKq9Vv40BQY2boknGPVOmUnp-bS3RsCT2LP9IvvilUTx3B4oyXYLcydzNJc99FtdcCUktSC2ZqY9eJW-D8tuy1eT0 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:43:17.693038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7baa5449b82446198b16e944162aa85b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7baa5449b82446198b16e944162aa85b", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 9583c43bffb24329b5e06b1e749affd8 Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.694191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'server_id': '7277dc44-caaa-4b10-b713-316c31209aa4'} Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:43:17.695016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:17.696122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:17.697340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Returning 404 to user: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:43:17.697340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4b4a5f80-9c5e-44ab-a849-991bc0cba539 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032884 Jun 06 20:43:17.697340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 91/168] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:43:17 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:43:17.730016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:17.737940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d5b0133a-8caf-47b0-b05b-d9ba47fb86d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.173420 Jun 06 20:43:17.738860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 78/169] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:17 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:18.755170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:18.755821 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:18.761776 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:18.762217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:18.762963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:18.763409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:18.910367 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:18.918639 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-46295b45-65f2-4f2c-ba62-40931f21766c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.167358 Jun 06 20:43:18.919314 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 92/170] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:18 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:19.075428 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:19.075983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:19.083483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.083901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.084678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.085142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.103693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] HTTP exception thrown: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Request method failure captured: Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 HTTP/1.1 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmafHYvQiBgTUgSxbdk2QW1o3hNScrPkpBHiyisQkcE3Ab6Ym6-yLh-lmVHou2zv-OLzqyv56u8ToLsS7d0dBcmKq9Vv40BQY2boknGPVOmUnp-bS3RsCT2LP9IvvilUTx3B4oyXYLcydzNJc99FtdcCUktSC2ZqY9eJW-D8tuy1eT0 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:43:19.108882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7baa5449b82446198b16e944162aa85b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7baa5449b82446198b16e944162aa85b", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 9583c43bffb24329b5e06b1e749affd8 Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.110042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '7277dc44-caaa-4b10-b713-316c31209aa4'} Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:43:19.110825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.111914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.113142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Returning 404 to user: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:43:19.113142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7729a9b7-5099-49e9-a0c1-09b99a245e61 tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 404 len: 111 microversion: 2.1 time: 0.039953 Jun 06 20:43:19.113142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 79/171] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:43:19 2022] DELETE /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:43:19.119674 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:19.120518 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] [instance: 7277dc44-caaa-4b10-b713-316c31209aa4] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:19.127317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.128048 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.129124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.129773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.144039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] HTTP exception thrown: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Request method failure captured: Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 HTTP/1.1 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmafHYvQiBgTUgSxbdk2QW1o3hNScrPkpBHiyisQkcE3Ab6Ym6-yLh-lmVHou2zv-OLzqyv56u8ToLsS7d0dBcmKq9Vv40BQY2boknGPVOmUnp-bS3RsCT2LP9IvvilUTx3B4oyXYLcydzNJc99FtdcCUktSC2ZqY9eJW-D8tuy1eT0 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:43:19.145848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7baa5449b82446198b16e944162aa85b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7baa5449b82446198b16e944162aa85b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7baa5449b82446198b16e944162aa85b", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 7baa5449b82446198b16e944162aa85b Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-DeleteServersTestJSON-1667438811 Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 9583c43bffb24329b5e06b1e749affd8 Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-DeleteServersTestJSON-1667438811-project Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.147240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '7277dc44-caaa-4b10-b713-316c31209aa4'} Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:43:19.148290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. Jun 06 20:43:19.149318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:43:19.152262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] Returning 404 to user: Instance 7277dc44-caaa-4b10-b713-316c31209aa4 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:43:19.153170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8b830ffb-f7f1-44de-ba99-51ddcfcaf2bc tempest-DeleteServersTestJSON-1667438811 tempest-DeleteServersTestJSON-1667438811-project] 10.222.0.41 "GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4" status: 404 len: 111 microversion: 2.1 time: 0.037692 Jun 06 20:43:19.154130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 93/172] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:19 2022] GET /compute/v2.1/servers/7277dc44-caaa-4b10-b713-316c31209aa4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:43:19.940467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:19.941512 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:19.952292 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.958316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.958316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:19.958316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:19.976102 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:20.192981 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:20.200424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-096d1d2f-0f83-4084-b698-893e163819bc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.268394 Jun 06 20:43:20.201273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 80/173] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:19 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:21.219388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:21.220368 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:21.247402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:21.247402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:21.247402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:21.247402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:21.426885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:21.442899 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c3d68010-a1b0-4008-b159-6650220c43d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.228024 Jun 06 20:43:21.443535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 94/174] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:21 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:22.460803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:22.461689 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:22.470680 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:22.471142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:22.471945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:22.472385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:22.628318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:22.640258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-88b7fe69-61b7-4641-a335-b934ab4fcf3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.183515 Jun 06 20:43:22.641113 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 81/175] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:22 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:23.658532 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:23.659504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:23.671390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:23.672462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:23.673875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:23.674593 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:23.951849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:23.951849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7cfc5a0f-93b8-4cf6-b25a-2be4eb9b7d2d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.207393 Jun 06 20:43:23.951849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 95/176] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:23 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:24.961379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:24.961994 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:24.980281 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:24.982193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:24.983012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:24.985546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:25.146873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:25.154929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e9930ad5-c3d0-4d26-9f9b-a8180a53d099 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.202800 Jun 06 20:43:25.155680 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 82/177] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:24 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:26.175531 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:26.176457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:26.185742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:26.186390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:26.187533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:26.189082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:26.358437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:26.366670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8e14a9ae-eea9-47ec-bb38-5c5ce23a6b8c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.197378 Jun 06 20:43:26.367841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 96/178] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:26 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:27.397153 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:27.398909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:27.417150 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:27.417650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:27.422444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:27.422444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:27.636087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:27.644972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f5229ea0-1737-4e9a-aa27-bc37a1463c3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.256224 Jun 06 20:43:27.645550 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 83/179] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:27 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:28.662367 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:28.663505 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:28.670270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:28.670715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:28.671622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:28.672087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:28.807146 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:28.814552 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1d2cb676-0f92-496d-8c11-8311949cd139 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.156063 Jun 06 20:43:28.815116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 97/180] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:28 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:29.831215 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:29.831819 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:29.839955 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:29.840435 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:29.841195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:29.841720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:29.971450 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:29.979370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-96709606-768d-4719-a692-2b1a5272a2da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.152452 Jun 06 20:43:29.979977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 84/181] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:29 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:30.996367 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:30.996982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:31.003135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:31.003588 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:31.004390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:31.004829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:31.135468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:31.143369 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-90872da6-6cad-4c67-a8f8-97950f5f3982 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.150853 Jun 06 20:43:31.143979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 98/182] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:30 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:32.160742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:32.161346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:32.167845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:32.168291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:32.169813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:32.170246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:32.304847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:32.313962 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-193ff4eb-66bb-4a1b-8fd1-a988ef1e07be tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.156976 Jun 06 20:43:32.315992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 85/183] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:32 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:33.335577 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:33.335577 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:33.339936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:33.340391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:33.341161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:33.341596 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:33.493149 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:33.505837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7442ac92-d24d-4fc5-b32a-abe25965d82f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.176848 Jun 06 20:43:33.507134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 99/184] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:33 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:34.523671 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:34.524297 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:34.531464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:34.532039 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:34.532792 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:34.533219 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:34.657456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:34.664756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-47c9ffa9-97ce-4825-b9cb-d38c5ef0d48d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.144896 Jun 06 20:43:34.665317 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 86/185] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:34 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:35.681150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:35.681756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:35.688293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:35.688742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:35.689493 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:35.689923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:35.813145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:35.820489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4887d1be-0faf-4b84-be37-8ddd6dc3cd9a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.143206 Jun 06 20:43:35.821050 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 100/186] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:35 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:36.837971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:36.838644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:36.845993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:36.846446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:36.847222 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:36.847656 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:36.980210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:36.987828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-af1e224e-d366-4095-9b0e-5043335478d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.153717 Jun 06 20:43:36.988369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 87/187] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:36 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:38.005007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:38.010775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:38.010775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=52 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:38.020072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:38.020641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:38.021433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:38.022013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:38.157670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:38.165444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d8b4189e-3ce0-46ac-9709-607ba4b5e7a8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.164422 Jun 06 20:43:38.166170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 101/188] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:37 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:39.183954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:39.185804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:39.188347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=40 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:39.203942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:39.203942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:39.203942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:39.203942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:39.359787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:39.367376 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7b123857-cd39-4d60-973c-9d13246b7fe0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1520 microversion: 2.1 time: 0.188035 Jun 06 20:43:39.367967 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 88/189] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:39 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:40.386769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:40.386769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:40.392271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:40.392733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:40.393487 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:40.393914 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:40.578729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:40.586496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d6588579-6ed8-4879-8751-94a85604160b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1500 microversion: 2.1 time: 0.205469 Jun 06 20:43:40.587057 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 102/190] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:40 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1500 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:40.602632 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:40.603239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:40.609636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:40.610492 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:40.610820 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:40.611249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:40.751418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:40.759386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2b56b227-04d9-4a24-85e1-dd85b73f9f00 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1514 microversion: 2.1 time: 0.160453 Jun 06 20:43:40.764730 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 89/191] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:40 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:42.629594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:43:42.630564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:42.636614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:42.637071 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:42.637834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:42.638268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:42.642610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=96 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:42.661924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'flavor' on Instance uuid ab8acd09-79a4-423a-9e5b-91aff7b7fce8 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:43:42.937595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-02dc6433-e9b2-45fe-9e1d-62dad66c4b3f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/action" status: 200 len: 32 microversion: 2.1 time: 0.313065 Jun 06 20:43:42.938416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 103/192] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:43:42 2022] POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 20:43:42.960629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:42.964958 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:42.973816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:42.974263 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:42.975481 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:42.976143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:43.139639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:43.147331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-92941d96-fd7a-4dd3-b8e3-23873f7ca710 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.201648 Jun 06 20:43:43.152197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 90/193] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:42 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:44.165356 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:44.166051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:44.172830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:44.173267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:44.174014 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:44.174441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:44.299833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:44.307322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4a66dc18-d202-43a5-b846-283391d83df8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.146125 Jun 06 20:43:44.307930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 104/194] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:44 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:45.325069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:45.325704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:45.332058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:45.332501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:45.333255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:45.333685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:45.464159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:45.472370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cc0e3c7d-b0f2-4cb5-a08e-701d082b6635 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.151269 Jun 06 20:43:45.473178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 91/195] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:45 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:46.490623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:46.491318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:46.498202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:46.498639 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:46.499392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:46.499848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:46.628341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:46.635789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7f8a198d-5ee3-44f0-bcd5-1fc1937c1c0a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.149214 Jun 06 20:43:46.636363 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 105/196] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:46 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:47.663623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:47.663623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:47.663623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:47.663623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:47.664632 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:47.664632 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:47.805443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:47.813150 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2872f3da-9594-4006-839a-c21455390c66 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.163250 Jun 06 20:43:47.813763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 92/197] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:47 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:48.830242 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:48.830846 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:48.837016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:48.837655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:48.838445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:48.839020 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:48.977982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:48.987411 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-567d52e9-eb8b-4365-95bd-f96729234c82 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.160756 Jun 06 20:43:48.989149 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 106/198] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:48 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:50.005062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:50.005588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:50.013850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:50.014482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:50.016181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:50.017190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:50.194076 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:50.198721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5bb4b297-473d-4960-8244-cacc9bd69716 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.197563 Jun 06 20:43:50.199279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 93/199] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:50 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:51.215920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:51.216391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:51.223683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:51.224135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:51.225357 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:51.225965 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:51.364418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:51.371902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-38d517a3-2a75-405c-9fce-8f0c0a47944a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.159979 Jun 06 20:43:51.373269 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 107/200] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:51 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:52.389301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:52.389892 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:52.397773 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:52.398462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:52.399445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:52.400111 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:52.583876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:52.596945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a275459d-5be4-45f9-90fe-5b477a8f051e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.211370 Jun 06 20:43:52.598164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 94/201] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:52 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:53.615948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:53.616504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:53.624351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:53.625015 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:53.626724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:53.627752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:53.846109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:53.855467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3902e867-ad9b-4730-b6a8-21f6b4e96376 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.243491 Jun 06 20:43:53.856510 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 108/202] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:53 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:54.872942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:54.874381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:54.881176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:54.881562 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:54.882318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:54.883015 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:55.096080 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:55.123078 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2d394866-24be-461f-a0a8-40fd0d395af8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.254306 Jun 06 20:43:55.123685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 95/203] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:54 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:56.148971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:56.148971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:56.152625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:56.159625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:56.160527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:56.160977 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:56.344204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:56.351191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5ae8cee2-c5b1-44b6-a9de-24264e842fb1 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.215082 Jun 06 20:43:56.351801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 109/204] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:56 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:57.369426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:57.370322 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:57.380536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:57.380536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:57.380536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:57.381288 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:57.547937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:57.553759 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:43:57.560496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9ca6819b-7ca7-4eeb-8bbc-66706c2e29ff tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.194669 Jun 06 20:43:57.561934 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 96/205] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:57 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:43:57.910676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:57.911697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:57.918037 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:57.918490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:57.919279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:57.919741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:57.943552 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0d956171-f14c-43b2-be9d-83f0b901736b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/ips" status: 200 len: 151 microversion: 2.20 time: 0.036782 Jun 06 20:43:57.944941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 110/206] 10.222.0.41 () {60 vars in 1288 bytes} [Mon Jun 6 20:43:57 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:43:58.579967 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:58.580692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:58.588001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:58.588445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:58.589230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:58.589659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:58.720295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:58.727724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3c65897e-ed4e-4c6e-afbc-ff8a99b993c7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.153137 Jun 06 20:43:58.728284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 97/207] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:58 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:43:59.744690 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:43:59.745329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:43:59.751296 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:59.751773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:59.752535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:43:59.752968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:43:59.892505 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:43:59.899960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-824d4b5c-d5ca-4895-bb13-c58f2ef82e64 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.159073 Jun 06 20:43:59.900533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 111/208] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:43:59 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:00.917712 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:00.918346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:00.924982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:00.925441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:00.926217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:00.926666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:01.054104 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:01.062406 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-98be6e6e-4da0-41d5-b625-ccd22d7b4b6c tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.148436 Jun 06 20:44:01.062979 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 98/209] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:00 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:02.080020 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:02.080620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:02.090035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:02.090566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:02.091347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:02.091856 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:02.223066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:02.232905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2ae985fa-b651-450d-a2aa-79279e1b4d8b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.156933 Jun 06 20:44:02.233441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 112/210] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:02 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:03.250455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:03.251228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:03.258129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:03.258579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:03.259354 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:03.259813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:03.395546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:03.403263 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-60b732aa-0a25-4ed9-959a-e7b28b4cb647 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.156765 Jun 06 20:44:03.403936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 99/211] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:03 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:04.078388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:04.078925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:04.084946 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.085392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.086154 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.086585 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.109549 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lazy-loading 'flavor' on Instance uuid 2b0b8d95-6069-4aec-bb06-9371a5bfc63e {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:44:04.421942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:04.422634 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:04.428919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.429363 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.430120 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.430779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.590170 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:04.598272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a62d0b7c-3bf6-478f-a848-753dd5ce5940 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.180756 Jun 06 20:44:04.599688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 100/212] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:04 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:04.701233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-04b393ed-5a37-49cf-811d-b43c2a34a77b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/action" status: 202 len: 0 microversion: 2.20 time: 0.626748 Jun 06 20:44:04.706556 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 113/213] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 20:44:04 2022] POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:44:04.715090 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:04.716208 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:04.723303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.723933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.724666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:04.725094 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:04.864389 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:04.874487 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:04.876027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:04.878811 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-887925e4-0fa7-4427-a7b2-d900d2a40aa2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.167691 Jun 06 20:44:04.878811 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 101/214] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:04 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:05.105593 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:05.106102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:05.113070 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.113517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.114322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.114709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.142627 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d7322571-fa62-4a37-b037-0cb44701ec48 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/ips" status: 200 len: 146 microversion: 2.1 time: 0.041301 Jun 06 20:44:05.143216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 114/215] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:44:05 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:05.622326 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:05.622326 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:05.622841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.622986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.623984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.624422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.758360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:05.766912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9ced7ee3-93ee-457d-8c66-45c0d24e929a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1500 microversion: 2.1 time: 0.155297 Jun 06 20:44:05.767584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 102/216] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:05 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:05.784666 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9e9401-03a0-4bfd-a054-fe8086d8786e"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:05.785751 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:05.792055 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.792527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.793275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.793703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.819256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] HTTP exception thrown: Cannot 'attach_volume' instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 while it is in vm_state rescued Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Request method failure captured: Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/os-volume_attachments HTTP/1.1 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 74 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmauKKDC_pjMkLbjlQHnS_V0pO7S5z25CA25lTZCfKtnWZzDQ0PmQ1smF7PeF_kSgeBsGJtrS3clGfPhg5jpf_oFa9gJ-qILgOHN9u8sPawE023JzgJ3OZcl81kIfaX2ctg5buPM1qDtujGhvQYDvT3hPjnecxmf5L7wL_-8t7g3zRo Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:44:05.820999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffb14a29d13a483ba8733e0bb3a56a17", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a10ffb60631240fdb6b4a69d6d7f73e2 Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {"volumeAttachment": {"volumeId": "ef9e9401-03a0-4bfd-a054-fe8086d8786e"}} Jun 06 20:44:05.822488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Cannot 'attach_volume' instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 while it is in vm_state rescued Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'server_id': 'ab8acd09-79a4-423a-9e5b-91aff7b7fce8', 'body': {'volumeAttachment': {'volumeId': 'ef9e9401-03a0-4bfd-a054-fe8086d8786e'}}} Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:44:05.823307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 while it is in vm_state rescued Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:44:05.824780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 while it is in vm_state rescued Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Returning 409 to user: Cannot 'attach_volume' instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 while it is in vm_state rescued {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-719cd089-65e0-4150-812e-aacea7b0219f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042037 Jun 06 20:44:05.826024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 115/217] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:44:05 2022] POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 20:44:05.831979 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:05.832515 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:05.838502 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.838948 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.839810 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.840308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.896654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:05.897259 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:05.903298 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.903783 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:05.904546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:05.905483 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:06.034357 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:06.036660 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:06.042966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:06.044536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:06.046282 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-288e14d2-9d92-4e04-a144-7bcf89a7a54e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.153016 Jun 06 20:44:06.046837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 116/218] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:05 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:06.055689 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c72b4530-f472-492b-9d84-cd983021d523 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/action" status: 202 len: 0 microversion: 2.1 time: 0.227421 Jun 06 20:44:06.056375 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 103/219] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:44:05 2022] POST /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:44:06.068543 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:06.069244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:06.075282 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:06.075772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:06.076541 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:06.077620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:06.206206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:06.213496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d169072c-2502-40e9-81bd-fdccd83fdb62 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.148685 Jun 06 20:44:06.214088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 117/220] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:06 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:07.066210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:07.066912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:07.073079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:07.073528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:07.074284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:07.074720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:07.198636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:07.206704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:07.208230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:07.209376 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c55ee918-5f90-4f24-bbac-fcc9465759a7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.148488 Jun 06 20:44:07.209927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 104/221] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:07 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:07.230904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:07.231508 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:07.238722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:07.239165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:07.239963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:07.240399 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:07.370480 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:07.378426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-50dac257-2012-4971-8342-af503f4d5d73 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.151352 Jun 06 20:44:07.378979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 118/222] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:07 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:08.226258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:08.226928 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:08.235301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:08.237447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:08.237447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:08.237447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:08.385040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:08.394889 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:08.396623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:08.397735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:08.398319 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-10ff4e6e-c699-4287-bff3-b2e039dc520b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.175674 Jun 06 20:44:08.398400 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:08.404857 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 105/223] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:08 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:08.405122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=36 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:08.405928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:08.406424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:08.407258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:08.407706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:08.625022 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:08.634393 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ccfef092-a326-4a44-acb6-3ac265d16623 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.240085 Jun 06 20:44:08.643173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 119/224] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:08 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:09.417437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:09.418038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:09.420663 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=36 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:09.426603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:09.427051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:09.428190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:09.428625 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:09.583140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:09.591213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:09.592778 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:09.594492 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-97cffe21-e643-43d4-954e-4d3c71153bea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.180387 Jun 06 20:44:09.595050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 106/225] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:09 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:09.653158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:09.653769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:09.660681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:09.661236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:09.662152 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:09.662601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:09.802245 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:09.810430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d27ed338-61b2-4196-8425-f8fac9f486ce tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.161302 Jun 06 20:44:09.810990 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 120/226] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:09 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:10.612192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:10.612803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:10.619395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:10.620004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:10.620775 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:10.621254 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:10.797141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:10.806030 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:10.807364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:10.808568 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-deee33fb-7834-48df-aad1-b20a42df8c6c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.200861 Jun 06 20:44:10.809126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 107/227] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:10 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:10.827340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:10.842895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:10.842895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:10.842895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:10.842895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:10.843418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:10.989845 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:10.999811 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c85796e7-75e2-4f43-893e-7689d165f573 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.175710 Jun 06 20:44:11.000708 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 121/228] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:10 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:11.826362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:11.827058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:11.834075 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:11.834511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:11.835264 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:11.835712 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:11.963105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:11.971151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:11.972697 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:11.973833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3390ef2d-04fc-4023-b21e-34668280c1fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.151389 Jun 06 20:44:11.974380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 108/229] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:11 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:12.017771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:12.018584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:12.024839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:12.025283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:12.026049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:12.026476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:12.159949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:12.167472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e250c741-66d3-48fb-992e-c5a0dc6b2057 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.154572 Jun 06 20:44:12.168072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 122/230] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:12 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:12.992878 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:12.993529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:13.000837 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:13.001280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:13.002053 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:13.002699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:13.142275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:13.151007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:13.152836 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:13.153995 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6f973ac8-76b1-4a52-9a68-2ef289ef3a9c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.164978 Jun 06 20:44:13.154547 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 109/231] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:12 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:13.183983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:13.184591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:13.191117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:13.191574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:13.192453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:13.192890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:13.329946 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:13.337410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e2810ade-7a30-4682-94cd-91b69417114b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1508 microversion: 2.1 time: 0.157157 Jun 06 20:44:13.337904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 123/232] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:13 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:14.174004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:14.174756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:14.192296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:14.192748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:14.199236 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:14.199236 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:14.351031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:14.356444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:14.357599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:14.372652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:14.375619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:14.376768 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:14.377111 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:14.377697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:14.378422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:14.379615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-124ac81b-6fee-417f-87fc-8493c66d3438 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.210140 Jun 06 20:44:14.380200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 110/233] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:14 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:14.597868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:14.605832 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-be075798-148b-4438-958f-29d52ae3dcbe tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1514 microversion: 2.1 time: 0.255194 Jun 06 20:44:14.606489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 124/234] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:14 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:15.202058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecd6511-6834-4b15-b6bc-9c723d7b37d8"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:15.203248 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:15.215566 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:15.220511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:15.221531 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:15.222035 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:15.398815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:15.399365 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:15.406028 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:15.407008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:15.407854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:15.408293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:15.548479 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:15.557901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:15.559458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:15.560775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b8772b9a-5039-4e41-9b71-7d95daca36a9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.166202 Jun 06 20:44:15.562016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 125/235] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:15 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:15.745804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:16.380479 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-96053d3e-694b-4c8d-b7ed-68ded59f2ba4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: .version_select at 0x7fdaea45c8b0>, body: {"keypair": {"name": "tempest-keypair-1254335622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDJsFpXh8speP/M95nRqGmA5TQxKhiGNA8vuPPjydzslE1Qad77ULklKSsekM3+K1zXdqTC7J4ACpejg7zkwJhDjRypqCwLkPGxTYLuZ8+Wm9dR7uKuirXd3tH/sc/byA=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:16.401138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-96053d3e-694b-4c8d-b7ed-68ded59f2ba4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:44:16.405689 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-96053d3e-694b-4c8d-b7ed-68ded59f2ba4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for user a10ffb60631240fdb6b4a69d6d7f73e2 and project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:44:16.410729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1a1dea4c-6ff2-4817-88c0-7ce7f2a5acd3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212928 Jun 06 20:44:16.411211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 111/236] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:44:15 2022] POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments => generated 194 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:44:16.510703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-96053d3e-694b-4c8d-b7ed-68ded59f2ba4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140871 Jun 06 20:44:16.511622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 126/237] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:44:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:44:16.582481 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:16.583183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:16.589591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:16.590038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:16.590842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:16.591274 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:16.759642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:16.768231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:16.769734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:16.770911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-df5d7120-460a-41e7-a832-4466f57bbf9f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.194963 Jun 06 20:44:16.771470 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 112/238] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:16 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:17.790011 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:17.790622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:17.796862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:17.797959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:17.798734 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:17.799164 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:17.956785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:17.965197 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:17.975261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:17.975261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-886a33b6-f7c1-496a-bca3-d6db9f89fbeb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.181892 Jun 06 20:44:17.975261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 127/239] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:17 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:18.986182 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:18.986801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:18.993249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:18.993690 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:18.994441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:18.994850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:19.127325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:19.135215 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:19.136720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:19.139382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ee3eb002-3a90-4328-b618-821b05d194dc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.155614 Jun 06 20:44:19.139382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 113/240] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:18 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:19.270836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-658606956", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e6c1431-6421-49ec-9458-fa7de78be53c"}], "security_groups": [{"name": "tempest-securitygroup--1990984170"}], "key_name": "tempest-keypair-1254335622", "user_data": "}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:19.370058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] validate_networks() for [('3e6c1431-6421-49ec-9458-fa7de78be53c', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:44:19.749644 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:44:19.750201 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:44:19.751135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:44:19.751610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:44:19.756274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:44:19.761219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:19.761712 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:19.762505 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:19.762938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:19.781097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:44:19.785132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Getting quotas for user a10ffb60631240fdb6b4a69d6d7f73e2 and project ffb14a29d13a483ba8733e0bb3a56a17. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:44:19.796566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:44:19.798887 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:44:19.888925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4f1b2d88-22f4-48ac-8c67-44326f47f247 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.623139 Jun 06 20:44:19.889633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 128/241] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:44:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:44:19.900304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0f89c225-31de-4ff8-a8f2-cd7e2f9b14bb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:19.905405 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0f89c225-31de-4ff8-a8f2-cd7e2f9b14bb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:19.963602 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0f89c225-31de-4ff8-a8f2-cd7e2f9b14bb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:19.972417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0f89c225-31de-4ff8-a8f2-cd7e2f9b14bb tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1245 microversion: 2.1 time: 0.075629 Jun 06 20:44:19.973672 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 114/242] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:19 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:20.157790 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:20.157983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:20.164548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:20.165158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:20.165920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:20.166349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:20.313676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:20.318747 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:20.320275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:20.321446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6c51ce01-a1c1-44de-b694-19936f2d1c2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.167997 Jun 06 20:44:20.322004 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 129/243] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:20 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:20.989885 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:20.990516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:20.997226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:20.997709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:20.998468 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:20.998901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:21.058794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:21.066264 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-682f563c-4712-494a-a0ed-5febf09e948a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1249 microversion: 2.1 time: 0.080212 Jun 06 20:44:21.066975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 115/244] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:20 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:21.340177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:21.340924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:21.347601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:21.348278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:21.349047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:21.349504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:21.491520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:21.513137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:21.513137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:21.513137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e1b7b697-5950-4d6d-913f-81eecfbec7fd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1745 microversion: 2.20 time: 0.167757 Jun 06 20:44:21.513491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 130/245] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:21 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:22.083446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:22.084261 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:22.090387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:22.091072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:22.091991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:22.092428 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:22.154464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:22.164244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-441263f2-d84c-4a98-b75f-4be70838696b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1297 microversion: 2.1 time: 0.084456 Jun 06 20:44:22.174645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 116/246] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:22 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:22.525815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:22.527045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:22.539610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:22.539610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:22.539610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:22.539610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:22.706746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:22.715968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:22.717952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:22.720178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1bc459a8-bf1b-4b59-8366-a74e43fbae02 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1745 microversion: 2.20 time: 0.199700 Jun 06 20:44:22.721265 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 131/247] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:22 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:23.183699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:23.185747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:23.194247 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:23.194881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:23.195860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:23.196412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:23.275698 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:23.288186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6e484ebb-b518-47d4-a06d-81856326e3b3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1303 microversion: 2.1 time: 0.109362 Jun 06 20:44:23.288889 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 117/248] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:23 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:23.739102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:23.739749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:23.746433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:23.752620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:23.752620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:23.752620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.015695 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:24.024613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:24.026131 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:24.027229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a0fd60b7-f66e-47e7-8900-97ad2b91b797 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1745 microversion: 2.20 time: 0.292669 Jun 06 20:44:24.036001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 132/249] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:23 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1745 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:24.197125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-28b82c76-b516-46f8-8987-455bbe566bfc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:24.205252 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-28b82c76-b516-46f8-8987-455bbe566bfc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.205834 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-28b82c76-b516-46f8-8987-455bbe566bfc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.309293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:24.311590 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:24.324228 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.329896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.330869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.331403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.369426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-28b82c76-b516-46f8-8987-455bbe566bfc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Going to try to stop instance {{(pid=124578) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 20:44:24.585603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-28b82c76-b516-46f8-8987-455bbe566bfc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action" status: 202 len: 0 microversion: 2.1 time: 0.389908 Jun 06 20:44:24.585603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 118/250] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:44:24 2022] POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:44:24.586681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-f36a4670-2422-4fec-b491-4535efa99fba req-3b181fdc-689c-4166-9aa3-4a30f7285ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "name": "network-vif-plugged", "status": "completed", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:24.595823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f36a4670-2422-4fec-b491-4535efa99fba req-3b181fdc-689c-4166-9aa3-4a30f7285ec7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.596507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f36a4670-2422-4fec-b491-4535efa99fba req-3b181fdc-689c-4166-9aa3-4a30f7285ec7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.610688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-f36a4670-2422-4fec-b491-4535efa99fba req-3b181fdc-689c-4166-9aa3-4a30f7285ec7 service nova] Creating event network-vif-plugged:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:44:24.616387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-f36a4670-2422-4fec-b491-4535efa99fba req-3b181fdc-689c-4166-9aa3-4a30f7285ec7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033265 Jun 06 20:44:24.617173 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 119/251] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:24.622552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:24.623331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:24.630963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.631387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.632495 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.633185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.652923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:24.667988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5b0a744a-2388-4a97-a397-3561bc6d3c28 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.360533 Jun 06 20:44:24.671956 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 133/252] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:24 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:24.798044 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:24.808853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f1c65028-6231-4ac8-bc09-b3b282ebdc4e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.190146 Jun 06 20:44:24.809570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 120/253] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:24 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:24.854335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-585ca3de-cc7d-4c76-9071-33f3dc280749 req-190f2b44-9ac4-437d-807c-1a4f3a281717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:24.869689 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-585ca3de-cc7d-4c76-9071-33f3dc280749 req-190f2b44-9ac4-437d-807c-1a4f3a281717 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:24.870368 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-585ca3de-cc7d-4c76-9071-33f3dc280749 req-190f2b44-9ac4-437d-807c-1a4f3a281717 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:24.890846 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-585ca3de-cc7d-4c76-9071-33f3dc280749 req-190f2b44-9ac4-437d-807c-1a4f3a281717 service nova] Creating event network-changed:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:44:24.902294 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-585ca3de-cc7d-4c76-9071-33f3dc280749 req-190f2b44-9ac4-437d-807c-1a4f3a281717 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051443 Jun 06 20:44:24.902916 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 134/254] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:25.047745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:25.048381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:25.055722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.056305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:25.057069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.057502 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:25.208571 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:25.218331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:25.219901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:25.221062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a50d5a6e-e3ed-44db-a00b-c2b818368a8b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.178631 Jun 06 20:44:25.222209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 121/255] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:25 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:25.690490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:25.691455 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:25.704959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.705583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:25.706384 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.706867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:25.832769 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:25.833750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:25.840940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.841767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:25.842724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:25.843334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:26.030908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:26.034507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:26.046347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-50ee4fb6-f0dd-434c-8121-90f5f5829248 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.360780 Jun 06 20:44:26.050130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 135/256] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:25 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:26.083845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:26.096199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e581a895-9e3c-4daa-986e-f6dcb2d14a33 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.274224 Jun 06 20:44:26.096786 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 122/257] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:25 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:26.250247 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:26.251310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:26.258013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:26.258486 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:26.259247 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:26.259841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:26.434806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:26.446789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:26.449398 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:26.451551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5c64213e-b9d4-4d3a-9960-55fa66db0559 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.208971 Jun 06 20:44:26.453011 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 136/258] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:26 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:27.087230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:27.087230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:27.087230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.087230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.090046 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.091589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.114042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:27.115390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:27.133512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.135165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.137408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.140799 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.430409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:27.453462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1a719a36-678c-41d5-8170-588fcf35c400 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.344125 Jun 06 20:44:27.456324 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:27.458257 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 137/259] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:27 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:27.473656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:27.474733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:27.474897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-90c4b130-5fac-414b-8667-ee936b5e8811 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.412287 Jun 06 20:44:27.481630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.482471 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.483458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:27.484126 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:27.496669 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 123/260] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:27 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:27.687001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:27.698654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:27.707336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:27.709189 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d076769f-c62d-49e3-bd13-13b02f7f79f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.241766 Jun 06 20:44:27.709778 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 138/261] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:27 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:28.481107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:28.487024 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:28.495592 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.496376 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.499517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.500460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.504530 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:28.505721 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:28.515638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.515638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.516766 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.517361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.686164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:28.699013 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3fee359d-5218-42b3-a3bb-ce18afc0778f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.227903 Jun 06 20:44:28.711458 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 124/262] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:28 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:28.728054 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:28.728844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:28.735942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.741011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.741011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:28.741011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:28.777668 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:28.788506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6580a0ee-f324-4976-817c-5c8fdee520bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.288397 Jun 06 20:44:28.789426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 139/263] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:28 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:28.887563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:28.896498 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:28.898212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:28.899796 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f1c8f93f-fdd7-48e1-9d5b-1f814721d67c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.175513 Jun 06 20:44:28.913997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 125/264] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:28 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:29.717496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:29.719342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:29.729814 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:29.742036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:29.742036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:29.742036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:29.771862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:29.794521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=10 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:29.807409 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:29.812534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:29.833538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:29.834138 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:29.835244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:29.837692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:29.971801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:29.990970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:30.010890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5a607882-ffb0-4d37-9200-06a97d4273ef tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.297054 Jun 06 20:44:30.021861 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 140/265] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:29 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:30.028398 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:30.029427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:30.037485 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:30.037931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:30.038964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:30.039645 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:30.098198 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:30.111102 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0842ff17-c94d-4214-8db0-c5831c3c2268 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.308416 Jun 06 20:44:30.122522 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 126/266] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:29 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:30.254735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:30.280158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:30.282559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:30.284463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-26f25de8-2325-4b86-8890-4bc945265ff3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.261236 Jun 06 20:44:30.296148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 141/267] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:30 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:30.550540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-3af03c42-20d6-4bf2-87bc-4b3c90809745 req-4400365a-eebf-4168-988a-f223198e04cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "name": "network-vif-plugged", "status": "completed", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:30.561328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-3af03c42-20d6-4bf2-87bc-4b3c90809745 req-4400365a-eebf-4168-988a-f223198e04cd service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:30.562040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-3af03c42-20d6-4bf2-87bc-4b3c90809745 req-4400365a-eebf-4168-988a-f223198e04cd service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:30.580970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-3af03c42-20d6-4bf2-87bc-4b3c90809745 req-4400365a-eebf-4168-988a-f223198e04cd service nova] Creating event network-vif-plugged:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:44:30.587023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-3af03c42-20d6-4bf2-87bc-4b3c90809745 req-4400365a-eebf-4168-988a-f223198e04cd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040280 Jun 06 20:44:30.587651 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 127/268] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:44:31.030503 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:31.032592 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:31.040879 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.041387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.042310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.042804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.137301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:31.137301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:31.155071 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.155533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.160741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.161190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.379022 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:31.398854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2bbdf071-6149-4bf6-8a8d-e9c1f28f2ce7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.373378 Jun 06 20:44:31.403277 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 142/269] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:31 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:31.410658 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:31.411448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:31.431127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.434896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.435158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:31.435820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:31.480303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:31.490394 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ebba3ccc-d7d6-4754-91ce-45881a1be748 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.364743 Jun 06 20:44:31.506414 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 128/270] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:31 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:31.638763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:31.648406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:31.652302 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:31.653955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6a34a79e-72a7-4f68-868f-29d41e7d9c1e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.249447 Jun 06 20:44:31.655114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 143/271] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:31 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:32.416853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:32.417451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:32.424974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.425422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.426185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.426619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.429890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:32.514100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:32.515823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:32.528217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.530160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.530974 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.531459 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.629402 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:32.637373 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2ddfbce6-c75c-4600-9b05-5111216e9c6d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.224290 Jun 06 20:44:32.637948 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 129/272] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:32 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:32.677168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:32.677710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:32.683993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.684446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.685212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:32.685652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:32.698503 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:32.709386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b7e3045b-646e-4946-a1e1-3e7580fa1e85 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1371 microversion: 2.1 time: 0.199533 Jun 06 20:44:32.714579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 144/273] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:32 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:32.827029 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:32.837507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:32.839039 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:32.840215 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-93879a96-bd5d-4a63-8ce0-d3658c1e6309 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.167131 Jun 06 20:44:32.840763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 130/274] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:32 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:33.655403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:33.656081 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:33.668101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.676170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.676170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.676170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.745175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:33.750833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:33.753052 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.753509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.754287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.754716 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.944990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:33.955217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e00904d9-e138-4076-8e28-030c71ebc688 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1564 microversion: 2.1 time: 0.215291 Jun 06 20:44:33.956496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 131/275] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:33 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:33.964250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:33.967990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:33.968935 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:33.974476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e79121eb-0c6d-4162-8f0f-fd1a904c935f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.323077 Jun 06 20:44:33.976736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 145/276] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:33 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:33.981725 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:33.983031 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:33.985816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.986574 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.987467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.988081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.990096 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.990723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:33.991697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:33.992198 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:34.123817 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a256305d-4914-41c3-889a-bb14f0fd2a44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147397 Jun 06 20:44:34.124424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 146/277] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:44:33 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:34.194050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:34.209807 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:34.211318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:34.220012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c92e6768-296b-42ad-8930-95eb6da0cdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.261740 Jun 06 20:44:34.231178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 132/278] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:33 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:34.991977 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:34.994310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:35.003703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:35.004124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:35.005664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:35.006300 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:35.222620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:35.239169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:35.239963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:35.250801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c9a31e5e-80d5-4708-bbfe-3cee9397e3e0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.262764 Jun 06 20:44:35.262370 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 147/279] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:34 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:35.264330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:35.264862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:35.266321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:35.267092 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:35.441586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:35.451575 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:35.453118 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:35.454923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f0f942c2-b9b3-439c-9c87-66180a419b99 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.219838 Jun 06 20:44:35.455494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 133/280] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:35 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:35.795939 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-20cdd9ff-e812-478c-aff5-24de0fbf8ceb req-81099421-261f-4988-95f3-fc5e0e59137c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:35.805045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-20cdd9ff-e812-478c-aff5-24de0fbf8ceb req-81099421-261f-4988-95f3-fc5e0e59137c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:35.805708 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-20cdd9ff-e812-478c-aff5-24de0fbf8ceb req-81099421-261f-4988-95f3-fc5e0e59137c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:35.820010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-20cdd9ff-e812-478c-aff5-24de0fbf8ceb req-81099421-261f-4988-95f3-fc5e0e59137c service nova] Creating event network-changed:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:44:35.827299 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-20cdd9ff-e812-478c-aff5-24de0fbf8ceb req-81099421-261f-4988-95f3-fc5e0e59137c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035199 Jun 06 20:44:35.828896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 148/281] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:36.271822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:36.273037 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:36.282478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:36.282935 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:36.283761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:36.284212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:36.431230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:36.440678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e8e77d56-1529-4988-85dc-adbb3deb77cd tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.172760 Jun 06 20:44:36.441489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 134/282] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:36 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:36.474398 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:36.475087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:36.482558 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:36.483202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:36.484172 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:36.485346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:36.634839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:36.647538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:36.649041 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:36.650219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b5afa947-0da4-4744-9cc9-d3ed771a3ef2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.180269 Jun 06 20:44:36.650779 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 149/283] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:36 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:37.458695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:37.459864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:37.467720 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:37.468846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:37.469986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:37.470734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:37.638673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:37.647349 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ded84d39-1942-4578-bcac-0d33643e2518 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.193017 Jun 06 20:44:37.648202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 135/284] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:37 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:37.668420 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:37.669018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:37.675564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:37.676081 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:37.676852 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:37.677311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:37.809587 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:37.829441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:37.832217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:37.837868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-eda7270d-febb-47c3-bb59-4fa2761d00bc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1740 microversion: 2.20 time: 0.170224 Jun 06 20:44:37.837868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 150/285] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:37 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:38.665228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:38.665847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:38.672456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:38.672898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:38.673639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:38.674064 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:38.807756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:38.817432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-54583ea4-4cdc-40ec-9728-2bde57e295e7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.155993 Jun 06 20:44:38.818230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 136/286] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:38 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:38.852437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:38.853043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:38.855012 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:38.860202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:38.861093 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:38.861644 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:38.862078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:39.060303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:39.069350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:39.070997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:39.072314 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-225effd1-85cb-40c2-9a53-136363f0d580 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1722 microversion: 2.20 time: 0.223929 Jun 06 20:44:39.073248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 151/287] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:38 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:39.834685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:39.835284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:39.837576 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=64 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:39.842224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:39.843847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:39.843847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:39.843847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:40.043651 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:40.052330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d1ca982f-4e6d-4abd-abf9-2751c38300ee tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.221427 Jun 06 20:44:40.053220 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 137/288] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:39 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:40.090476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:40.092882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:40.097664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:40.098133 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:40.098935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:40.099490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:40.243065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:40.250236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:40.252362 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:40.253504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-96fbc71a-ec02-48ec-952c-a1f9d281a017 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1722 microversion: 2.20 time: 0.167069 Jun 06 20:44:40.254048 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 152/289] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:40 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:41.069331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:41.070544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:41.077477 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:41.077929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:41.078722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:41.079153 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:41.272454 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:41.273066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:41.280431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:41.280880 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:41.281663 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:41.282100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:41.300288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:41.474857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:41.485049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:41.488720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:41.490001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-74d80a86-892b-417f-884e-86b450022ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1722 microversion: 2.20 time: 0.221508 Jun 06 20:44:41.490560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 153/290] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:41 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:41.565807 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:41.574091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7658a8df-9eb3-44cb-a4db-da8a91e0b7ab tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1725 microversion: 2.1 time: 0.508475 Jun 06 20:44:41.574743 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 138/291] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:41 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:42.508134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:42.509515 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:42.517706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.518448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.520010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.521204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.592574 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:42.593594 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:42.615275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.625140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.625140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.625140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.775922 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:42.785761 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:42.787392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:42.788995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ddc318d8-b4ad-4450-9201-c0ee274bfa13 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1665 microversion: 2.20 time: 0.285192 Jun 06 20:44:42.789749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 154/292] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:42 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1665 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:42.794458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-121ae7d3-8159-4b5d-a2d1-46dbb5779ca0 req-35e9b129-7328-41ef-9683-9b015e764055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "name": "network-vif-unplugged", "status": "completed", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:42.806984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-121ae7d3-8159-4b5d-a2d1-46dbb5779ca0 req-35e9b129-7328-41ef-9683-9b015e764055 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.806984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-121ae7d3-8159-4b5d-a2d1-46dbb5779ca0 req-35e9b129-7328-41ef-9683-9b015e764055 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.816896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.compute.server_external_events [req-121ae7d3-8159-4b5d-a2d1-46dbb5779ca0 req-35e9b129-7328-41ef-9683-9b015e764055 service nova] Unable to find a host for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e. Dropping event network-vif-unplugged {{(pid=124579) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 20:44:42.818078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-121ae7d3-8159-4b5d-a2d1-46dbb5779ca0 req-35e9b129-7328-41ef-9683-9b015e764055 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027137 Jun 06 20:44:42.819262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 155/293] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 20:44:42.824382 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6da6751-90fd-41e6-bf0b-ac144e3d45e1"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:42.825756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:42.835155 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.835864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.837063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.837688 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:42.946356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:42.965501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f670d2d6-5295-4b0f-938d-f1393f854140 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1702 microversion: 2.1 time: 0.377155 Jun 06 20:44:42.966377 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 139/294] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:42 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1702 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:42.982313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-751f0079-cc13-494f-8447-db9aa5602fe5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:42.990887 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751f0079-cc13-494f-8447-db9aa5602fe5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:42.991692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751f0079-cc13-494f-8447-db9aa5602fe5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:43.016625 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-751f0079-cc13-494f-8447-db9aa5602fe5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Going to try to start instance {{(pid=124578) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 20:44:43.159997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-751f0079-cc13-494f-8447-db9aa5602fe5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action" status: 202 len: 0 microversion: 2.1 time: 0.181772 Jun 06 20:44:43.161041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 140/295] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:44:42 2022] POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:44:43.169404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:43.177486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:43.196134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:43.196134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:43.196134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:43.196134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:43.472044 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:43.482124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-410607fc-8c2d-4eb1-9aa5-1fe5b66c8ad7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1711 microversion: 2.1 time: 0.316679 Jun 06 20:44:43.488692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 141/296] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:43 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1711 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:44:44.040325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a233f43a-c32b-4425-8786-cdf9533926a2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.219695 Jun 06 20:44:44.040944 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 156/297] 10.222.0.41 () {62 vars in 1363 bytes} [Mon Jun 6 20:44:42 2022] POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 188 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:44:44.203395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:44.205311 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:44.217735 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.229911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.229911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.229911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.499929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:44.503304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:44.510186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-01d1f101-cace-4880-a46a-60bada6fc85e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/action" status: 202 len: 0 microversion: 2.20 time: 0.312359 Jun 06 20:44:44.511304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 142/298] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 20:44:44 2022] POST /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:44:44.525208 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.525954 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.526854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.527323 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.534476 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:44.535089 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:44.554549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.555326 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.562521 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:44.566453 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:44.697402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:44.707238 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8bcfbb43-0ccf-4596-9615-f8c7bd9f3f36 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1711 microversion: 2.1 time: 0.211158 Jun 06 20:44:44.707850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 157/299] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:44 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1711 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:44.938422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:44.944511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:44:44.952032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:44.955303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:44.967875 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c2d0fb4e-e4d9-44d4-bea9-8d614d8a98f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1751 microversion: 2.20 time: 0.426294 Jun 06 20:44:44.967875 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 143/300] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:44 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1751 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:45.724904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:45.725346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:45.731675 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:45.732347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:45.733304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:45.733735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:45.890081 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:45.901836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f846d632-d00d-4f45-b34a-46e3829e8a79 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1715 microversion: 2.1 time: 0.181286 Jun 06 20:44:45.902482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 158/301] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:44:45 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1715 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:44:45.975882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:45.976493 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:45.983273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:45.983749 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:45.984528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:45.984963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:46.130063 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:46.138724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:46.140490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:46.141971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-29e0d8e9-e235-4f61-86a0-8a11a238bc42 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1751 microversion: 2.20 time: 0.170073 Jun 06 20:44:46.143296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 144/302] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:45 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:47.162121 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:47.162724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:47.169731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:47.170391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:47.171181 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:47.171584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:47.333289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:47.342794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:47.344313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:47.346304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3152599e-f0e3-476a-9f94-260d55c16376 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1751 microversion: 2.20 time: 0.188987 Jun 06 20:44:47.347033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 159/303] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:47 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:48.366185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:48.366789 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:48.374094 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:48.374790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:48.375564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:48.376021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:48.564294 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:48.580797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:48.600614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:48.603082 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-283d7920-d720-4555-a958-9b7285a5d3ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1753 microversion: 2.20 time: 0.242021 Jun 06 20:44:48.604399 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 145/304] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:48 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1753 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:49.625099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:49.628790 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:49.643282 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:49.643770 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:49.644724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:49.645163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:50.000286 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:50.013355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:50.017867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:50.032017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1dcacd4a-dbb8-4089-a595-b01c584612f2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.412211 Jun 06 20:44:50.036507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 160/305] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:49 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:51.054772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:51.056002 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:51.064768 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:51.065220 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:51.066191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:51.066875 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:51.375033 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:51.385101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:51.386618 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:51.389186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a6302ef8-e822-48d3-8927-df64c7b8ff2c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.337345 Jun 06 20:44:51.389186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 146/306] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:51 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:52.380457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d7b7d279-ebf5-4ced-98b3-c763b0710e67 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Action: 'create', calling method: .version_select at 0x7fdaea3e99d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1131310682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzgWbS7IqZNW1TJ00CW9P4IQCfFUt9cU147NnNeq5jHM+xQxMwBKRWA3FmD+sTTVKPg55wayYC9ukIUVq0F/cZ0dMhh8RyMCfEataWHLiMYsAdygxTflFz55idLfh+v3g=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:44:52.397529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-d7b7d279-ebf5-4ced-98b3-c763b0710e67 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Getting quotas for project 3fc5fd4594f2462fad03b033bbd2aa59. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:44:52.406213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:52.408493 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:52.412640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-d7b7d279-ebf5-4ced-98b3-c763b0710e67 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Getting quotas for user b13ca365980f4250820a733efe5f44e9 and project 3fc5fd4594f2462fad03b033bbd2aa59. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:44:52.419427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:52.421729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:52.424338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:52.425145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:52.545155 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d7b7d279-ebf5-4ced-98b3-c763b0710e67 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.408652 Jun 06 20:44:52.545929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 161/307] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:44:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:44:52.610867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:52.630823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:52.635379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:52.637695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c3e98a38-37d8-4c6b-a6d5-bfe9a95ee390 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.235100 Jun 06 20:44:52.638678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 147/308] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:52 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:53.658463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:53.659278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:53.665678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:53.668694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:53.668694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:53.668694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:53.909781 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:53.920063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:53.921934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:53.923510 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-114f9319-926d-4b60-86e4-a80e67b731f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.269514 Jun 06 20:44:53.927371 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 162/309] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:53 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:54.947346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:54.948598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:54.959108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:54.959558 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:54.960362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:54.960794 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:55.232365 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:55.246973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:55.253645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:55.254880 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-669c8499-7aab-411c-9e23-4697d6bddda9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.312609 Jun 06 20:44:55.255437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 148/310] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:54 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:56.277065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:56.277664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:56.296945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:56.296945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:56.296945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:56.296945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:56.580818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:56.589539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:56.591035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:56.592415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-535eee2a-83df-4c7c-ba1c-80f5f2459807 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.321954 Jun 06 20:44:56.593257 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 163/311] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:56 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:44:57.611299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:57.612017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:57.618753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:57.619209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:57.620021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:57.620459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:57.762569 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:57.773079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:57.775295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:57.776983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-bfcb732b-4b75-4b3a-99a8-8573df69eaaa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.169644 Jun 06 20:44:57.777538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 149/312] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:57 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:44:58.796379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:44:58.797004 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:44:58.804490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:58.804937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:58.806357 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:44:58.806848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:44:58.965346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:58.976386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:58.980219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:44:58.981655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-54c3a186-4147-491c-923b-3a93c5be339b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.189734 Jun 06 20:44:58.982714 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 164/313] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:58 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:00.001814 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:00.002535 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:00.010189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:00.010645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:00.011426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:00.011907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:00.173789 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:00.185234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:00.186954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:00.188449 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-83afb91c-92d3-4b41-97b0-8a3a12590f4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.191198 Jun 06 20:45:00.189142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 150/314] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:44:59 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:00.806546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-444834399", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:01.207916 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:01.208521 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:01.215175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:01.215615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:01.216405 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:01.216833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:01.356456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:01.365278 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:01.366787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:01.367970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-64b722ba-7e89-43a1-89c3-75fe41912e58 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.164913 Jun 06 20:45:01.368538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 151/315] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:01 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:01.631841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] validate_networks() for None {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:45:01.913351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:45:01.913979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:45:01.914235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:45:01.914642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:45:01.915049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:45:01.926571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:01.927023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:01.927861 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:01.928303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:01.944685 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Getting quotas for project dbcd277f142a4a328f7553029beb300e. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:45:01.948732 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Getting quotas for user 8d6c989fe0044f3a808481b54362c019 and project dbcd277f142a4a328f7553029beb300e. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:45:01.959848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:45:01.962124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:45:02.092325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-55e4f15a-dce6-4d3a-8a75-43944a34b8a8 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289466 Jun 06 20:45:02.092970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 165/316] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:45:02.103933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-141cdd2b-133e-4701-8e25-56fc441008ec tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:02.104536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-141cdd2b-133e-4701-8e25-56fc441008ec tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:02.160639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-141cdd2b-133e-4701-8e25-56fc441008ec tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:02.168067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-141cdd2b-133e-4701-8e25-56fc441008ec tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1214 microversion: 2.1 time: 0.068203 Jun 06 20:45:02.179747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 152/317] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:02 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:02.387833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:02.388444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:02.395493 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:02.395977 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:02.396745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:02.397182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:02.526720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:02.535883 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:02.539594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:02.539594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4fab2521-cd28-4f5c-83d7-b018aa111fdd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.154845 Jun 06 20:45:02.539594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 166/318] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:02 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:03.185534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:03.186166 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:03.192764 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:03.193206 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:03.193968 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:03.194392 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:03.264616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:03.273126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fce0d31f-1bce-43d9-b398-81714427c8ea tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1218 microversion: 2.1 time: 0.091269 Jun 06 20:45:03.276813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 153/319] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:03 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:03.556999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:03.557645 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:03.564633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:03.565116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:03.565888 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:03.566322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:03.700639 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:03.708696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:03.710198 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:03.711354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-312770ea-383c-45b0-9e6e-8e3b65d65a0d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.158415 Jun 06 20:45:03.711934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 167/320] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:03 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:04.290368 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:04.290970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:04.312695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:04.313431 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:04.314867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:04.315307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:04.380924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:04.388505 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3ea1e13b-9cad-4d34-9cea-c004dd091c3e tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1284 microversion: 2.1 time: 0.102066 Jun 06 20:45:04.389065 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 154/321] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:04 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:04.730350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:04.730991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:04.737621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:04.738062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:04.738805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:04.739233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:04.974761 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:04.984146 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:04.987083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:04.988405 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-661854dd-883a-44fc-9034-f00c03900e66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.262125 Jun 06 20:45:04.995465 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 168/322] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:04 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:05.406400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:05.408162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:05.415149 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:05.415862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:05.416751 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:05.417287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:05.558854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:05.569619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e88d126c-5248-4cb0-93da-91cd52a51071 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.167274 Jun 06 20:45:05.570473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 155/323] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:05 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:06.006399 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:06.008804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:06.013465 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:06.013840 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:06.014647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:06.015097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:06.167877 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:06.170127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:06.177273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:06.178790 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:06.180017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3f5116af-bc3d-4ecb-831e-09d5cb2f28f8 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.177500 Jun 06 20:45:06.180584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 169/324] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:06 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:06.268601 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-bd18b89a-c560-47a8-957c-459b77d54984 req-1a4856e1-4758-42dc-bec3-9c92a73c6a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb7a989-b211-4ad1-9af1-d96e31d85792", "tag": "6c6711e1-d326-4bae-92ef-3596bb728394"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:06.277325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-bd18b89a-c560-47a8-957c-459b77d54984 req-1a4856e1-4758-42dc-bec3-9c92a73c6a2e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:06.277954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-bd18b89a-c560-47a8-957c-459b77d54984 req-1a4856e1-4758-42dc-bec3-9c92a73c6a2e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:06.293731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-bd18b89a-c560-47a8-957c-459b77d54984 req-1a4856e1-4758-42dc-bec3-9c92a73c6a2e service nova] Creating event network-changed:6c6711e1-d326-4bae-92ef-3596bb728394 for instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 on hv-cinder-84487 Jun 06 20:45:06.299068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-bd18b89a-c560-47a8-957c-459b77d54984 req-1a4856e1-4758-42dc-bec3-9c92a73c6a2e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036602 Jun 06 20:45:06.300156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 156/325] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:06.586885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:06.587499 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:06.594128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:06.594576 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:06.595394 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:06.595815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:06.792166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:06.801248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6f1f73b9-6e89-4fce-9eba-0c2c39031257 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.218509 Jun 06 20:45:06.801827 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 170/326] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:06 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:07.199286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:07.200011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:07.206855 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:07.207299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:07.208100 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:07.208533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:07.340175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:07.349258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:07.350802 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:07.352023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-07e3058a-5331-4897-8d24-e9396de30f47 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.157440 Jun 06 20:45:07.352568 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 157/327] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:07 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:07.817610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:07.818214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:07.824842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:07.825293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:07.826072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:07.826502 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:07.958929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:07.966705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7982f536-8b82-4571-88f3-ad26be65e3a6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.153471 Jun 06 20:45:07.967285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 171/328] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:07 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:08.370163 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:08.370762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:08.377904 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:08.378346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:08.379099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:08.379528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:08.516357 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:08.525743 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:08.527261 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:08.528474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-59b5d20e-39ef-4f27-bfca-b3416866660e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.162264 Jun 06 20:45:08.529025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 158/329] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:08 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:08.983431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:08.984069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:08.986476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:08.991513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:08.991995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:08.992762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:08.993200 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:09.123541 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:09.131433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4c5f8e6c-0990-4b14-8f04-1a637f5410c6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.151854 Jun 06 20:45:09.132121 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 172/330] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:08 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:09.547528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:09.548262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:09.555105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:09.555545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:09.556470 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:09.556813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:09.686459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:09.694797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:09.696319 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:09.697464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7ddf75ed-b1e8-4ec4-bc06-402d861682ae tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.154591 Jun 06 20:45:09.698019 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 159/331] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:09 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:10.148679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:10.149214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:10.155216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:10.155712 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:10.156473 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:10.156903 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:10.284958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:10.292318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-48d8cb49-94a6-4241-9b87-a358db7dafa6 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.147547 Jun 06 20:45:10.292868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 173/332] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:10 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:10.716093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:10.716810 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:10.719272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=50 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:10.723983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:10.724429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:10.725199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:10.725633 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:10.861470 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:10.871451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:10.873094 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:10.874208 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4b39b2d8-04cd-434d-bb04-0064b17fb8ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.162065 Jun 06 20:45:10.874765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 160/333] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:10 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:11.309089 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:11.309778 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:11.316697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:11.317172 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:11.317928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:11.318353 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:11.444338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:11.451804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5da5a03d-c4e8-4229-bc8e-9ddf038082fd tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.146452 Jun 06 20:45:11.452488 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 174/334] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:11 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:11.893524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:11.894059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:11.900491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:11.900936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:11.901702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:11.902134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:12.030524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:12.039418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:12.040935 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:12.042086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c7def11f-d1f3-4b68-979a-37046be42f61 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.153338 Jun 06 20:45:12.042638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 161/335] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:11 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:12.468788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:12.469392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:12.471287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:12.471970 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=10 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:12.476749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:12.477187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:12.477934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:12.478360 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:12.606213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:12.614151 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-513751fd-19ca-46e1-8e56-8e3420ec6887 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.149208 Jun 06 20:45:12.619175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 175/336] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:12 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:13.026930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-8ffca66a-ca6e-41dc-bbe7-2eadb52191f3 req-84b35dd9-bf91-4309-b952-205f7724fea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb7a989-b211-4ad1-9af1-d96e31d85792", "name": "network-vif-plugged", "status": "completed", "tag": "6c6711e1-d326-4bae-92ef-3596bb728394"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:13.030327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:13.036806 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8ffca66a-ca6e-41dc-bbe7-2eadb52191f3 req-84b35dd9-bf91-4309-b952-205f7724fea8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:13.037240 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8ffca66a-ca6e-41dc-bbe7-2eadb52191f3 req-84b35dd9-bf91-4309-b952-205f7724fea8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:13.041840 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=100 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:13.049503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-8ffca66a-ca6e-41dc-bbe7-2eadb52191f3 req-84b35dd9-bf91-4309-b952-205f7724fea8 service nova] Creating event network-vif-plugged:6c6711e1-d326-4bae-92ef-3596bb728394 for instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 on hv-cinder-84487 Jun 06 20:45:13.054540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-8ffca66a-ca6e-41dc-bbe7-2eadb52191f3 req-84b35dd9-bf91-4309-b952-205f7724fea8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031326 Jun 06 20:45:13.055441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 162/337] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:13.060573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:13.061273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:13.068340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:13.068785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:13.069544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:13.069976 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:13.240427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:13.254240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:13.254240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:13.254240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-faaf4d08-8542-4608-ba7e-a0bb280079a4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.195504 Jun 06 20:45:13.254684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 176/338] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:13 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:13.631760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:13.632457 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:13.639062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:13.645412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:13.645412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:13.645412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:13.776427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:13.783853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-911c1828-15d4-41d8-9bca-155824bfe017 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.156787 Jun 06 20:45:13.784408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 163/339] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:13 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:14.277865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:14.278462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:14.284456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:14.284889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:14.285630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:14.286056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:14.416898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:14.426640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:14.428171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:14.429407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1662106a-d41b-4b29-9fe4-b51c7664e226 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.155330 Jun 06 20:45:14.429991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 177/340] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:14 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:14.799573 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:14.800330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:14.807249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:14.807708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:14.808469 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:14.808895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:14.830701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-866805368", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1131310682", "security_groups": [{"name": "tempest-secgroup-smoke-556804598"}], "networks": [{"uuid": "85b2fd5d-895c-4cb2-bb5b-34be1c608ded"}], "block_device_mapping_v2": [{"uuid": "bda66e28-934b-47d1-8a0b-0bbb650e6e47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:14.937639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:14.940119 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] validate_networks() for [('85b2fd5d-895c-4cb2-bb5b-34be1c608ded', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:45:14.945130 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-81a536a7-d5c7-41a0-ac41-55bc534af712 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1314 microversion: 2.1 time: 0.149322 Jun 06 20:45:14.945692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 164/341] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:14 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:15.068637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-eda7e833-115d-47e2-91d4-807d839a3530 req-871074c9-ea81-4166-9251-abd25b38ab3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "name": "network-vif-plugged", "status": "completed", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:15.076500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-eda7e833-115d-47e2-91d4-807d839a3530 req-871074c9-ea81-4166-9251-abd25b38ab3a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.076942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-eda7e833-115d-47e2-91d4-807d839a3530 req-871074c9-ea81-4166-9251-abd25b38ab3a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.088019 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-eda7e833-115d-47e2-91d4-807d839a3530 req-871074c9-ea81-4166-9251-abd25b38ab3a service nova] Creating event network-vif-plugged:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:45:15.093115 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-eda7e833-115d-47e2-91d4-807d839a3530 req-871074c9-ea81-4166-9251-abd25b38ab3a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027969 Jun 06 20:45:15.094031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 165/342] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:45:15.294053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:45:15.294511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:45:15.294934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:45:15.295338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:45:15.295785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:45:15.305271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.305715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.306537 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.306968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.323535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Getting quotas for project 3fc5fd4594f2462fad03b033bbd2aa59. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:45:15.327260 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Getting quotas for user b13ca365980f4250820a733efe5f44e9 and project 3fc5fd4594f2462fad03b033bbd2aa59. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:45:15.383789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:45:15.385785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bda66e28-934b-47d1-8a0b-0bbb650e6e47',volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:45:15.447913 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:15.448660 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:15.455429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.455898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.456660 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.457096 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.587302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:15.596381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:15.597939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:15.599081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8dfb4083-3580-4d57-946d-313145717072 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.155615 Jun 06 20:45:15.599644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 166/343] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:15 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:15.818934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b41fd914-850f-47f4-9034-c7f26a48080a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.992222 Jun 06 20:45:15.819751 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 178/344] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:45:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 20:45:15.829469 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-692b9d58-5ede-4317-b464-d3606845f135 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:15.830070 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-692b9d58-5ede-4317-b464-d3606845f135 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:15.887588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-692b9d58-5ede-4317-b464-d3606845f135 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:15.895011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-692b9d58-5ede-4317-b464-d3606845f135 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1088 microversion: 2.1 time: 0.069329 Jun 06 20:45:15.899912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 167/345] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:15 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:15.962241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:15.963100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:15.969479 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.970290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:15.971172 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:15.971612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.143299 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.151273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f7b53927-af31-40f0-9922-0a7cec161818 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1464 microversion: 2.1 time: 0.192831 Jun 06 20:45:16.152170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 179/346] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:15 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:16.190782 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:16.191280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:16.199865 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.205846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.205846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.205846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.225844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:45:16.446231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7e879242-a58f-4c2e-9694-c0664c3a66a4 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 204 len: 0 microversion: 2.1 time: 0.259010 Jun 06 20:45:16.447065 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 168/347] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:45:16 2022] DELETE /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:45:16.455856 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:16.456457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:16.462924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.463372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.464150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.464621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.617708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:16.618309 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:16.624798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.625239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.626689 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.627131 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.768048 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.777412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.778915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.780170 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0e779a7b-8654-4fb9-a3d2-8f5ec704bd66 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.166867 Jun 06 20:45:16.780722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 169/348] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:16 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:16.836583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.843982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-47cfaa0a-d7b1-459c-b47b-9b09d0cb3151 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1470 microversion: 2.1 time: 0.392430 Jun 06 20:45:16.844537 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 180/349] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:16 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1470 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:16.911464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:16.914857 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:16.918909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.919348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.920137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:16.920564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:16.979318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:16.987195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f6615267-4f20-42d3-81d7-3869177b7a47 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1138 microversion: 2.1 time: 0.079598 Jun 06 20:45:16.987772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 170/350] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:16 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:17.798392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:17.799027 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:17.805002 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:17.805448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:17.806202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:17.806636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:17.861552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:17.862606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:17.869323 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:17.869775 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:17.870550 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:17.870984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:17.934683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:17.942974 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:17.944495 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:17.945650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-654c4b3a-61ee-4b40-9a3f-b58f92c28f67 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.151154 Jun 06 20:45:17.946212 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 181/351] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:17 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:18.001475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:18.003066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:18.003741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:18.009310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a3eb8736-c234-43ba-a9f6-6dbc9e537ac7 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1470 microversion: 2.1 time: 0.151858 Jun 06 20:45:18.009927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:18.010031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 171/352] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:17 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:18.010379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:18.011163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:18.011597 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:18.072686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:18.080823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7ed100b7-9c42-4a2f-b8aa-730b55bff34b tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1138 microversion: 2.1 time: 0.081664 Jun 06 20:45:18.081390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 182/353] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:17 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:18.847408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-a474f1b4-aaf4-4c7a-a48e-f3d89475bfc1 req-220dc541-b16e-4913-8ad7-c28a4c5777bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb7a989-b211-4ad1-9af1-d96e31d85792", "name": "network-vif-deleted", "tag": "6c6711e1-d326-4bae-92ef-3596bb728394"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:18.855679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a474f1b4-aaf4-4c7a-a48e-f3d89475bfc1 req-220dc541-b16e-4913-8ad7-c28a4c5777bc service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:18.856141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a474f1b4-aaf4-4c7a-a48e-f3d89475bfc1 req-220dc541-b16e-4913-8ad7-c28a4c5777bc service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:18.868494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-a474f1b4-aaf4-4c7a-a48e-f3d89475bfc1 req-220dc541-b16e-4913-8ad7-c28a4c5777bc service nova] Creating event network-vif-deleted:6c6711e1-d326-4bae-92ef-3596bb728394 for instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 on hv-cinder-84487 Jun 06 20:45:18.873308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-a474f1b4-aaf4-4c7a-a48e-f3d89475bfc1 req-220dc541-b16e-4913-8ad7-c28a4c5777bc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Jun 06 20:45:18.873905 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 172/354] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:18.965106 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:18.965716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:18.972875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:18.977304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:18.977304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:18.977304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:19.027783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:19.028576 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:19.035588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:19.036115 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:19.036970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:19.037736 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:19.103135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6c989fe0044f3a808481b54362c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd277f142a4a328f7553029beb300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:19.112397 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-622fc322-5161-4bab-be7d-600e6b298ca2 tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 200 len: 1299 microversion: 2.1 time: 0.088752 Jun 06 20:45:19.120253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 173/355] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:19 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:19.120253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:19.120253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:19.122743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:19.126668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:19.127177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:19.128073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:19.128619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:19.131442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:19.132988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:19.134136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f5aacc61-f0b5-4007-8a80-ca31350feafe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1809 microversion: 2.20 time: 0.173362 Jun 06 20:45:19.134689 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 183/356] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:18 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:45:19.191297 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:19.199723 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-56ee6d1f-3dec-4017-929f-62fa29d98a50 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1186 microversion: 2.1 time: 0.083744 Jun 06 20:45:19.206446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 174/357] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:19 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:20.130796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:20.132244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] [instance: 4fb7a989-b211-4ad1-9af1-d96e31d85792] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:20.137658 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.138106 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.138905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.139337 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.153061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] HTTP exception thrown: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. Jun 06 20:45:20.153241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:20.153785 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Request method failure captured: Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 HTTP/1.1 Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmdK5UEYWwALNtiJY3NMFIEe_YoQzm2adRPo0B3JBz9El1nZRhcDMxWkUOuENwtuXwxWQENWDVGO09LxnJUl_pQAfKfz-Ey2SSP3nRHiJmo3i76cJexzFz81MIACgcc0xE3HEyEcnuVjcmKICcfMKhsqlQ64Nv8jzOMGVQOsrDuL90E Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: dbcd277f142a4a328f7553029beb300e Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesNegativeTest-1696837061 Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:45:20.154729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/dbcd277f142a4a328f7553029beb300e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/dbcd277f142a4a328f7553029beb300e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/dbcd277f142a4a328f7553029beb300e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_dbcd277f142a4a328f7553029beb300e", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesNegativeTest-1696837061 Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: dbcd277f142a4a328f7553029beb300e Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesNegativeTest-1696837061 Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesNegativeTest-1696837061-project Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 8d6c989fe0044f3a808481b54362c019 Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesNegativeTest-1696837061-project Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. Jun 06 20:45:20.156237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '4fb7a989-b211-4ad1-9af1-d96e31d85792'} Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:45:20.157008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. Jun 06 20:45:20.158246 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:45:20.159321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] Returning 404 to user: Instance 4fb7a989-b211-4ad1-9af1-d96e31d85792 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:45:20.159321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fdfca505-9b49-455e-9d67-76ca650b754a tempest-VolumesNegativeTest-1696837061 tempest-VolumesNegativeTest-1696837061-project] 10.222.0.41 "GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792" status: 404 len: 111 microversion: 2.1 time: 0.030641 Jun 06 20:45:20.159321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 184/358] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:20 2022] GET /compute/v2.1/servers/4fb7a989-b211-4ad1-9af1-d96e31d85792 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:45:20.166328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.166746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.167537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.168889 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.217395 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:20.218105 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:20.224182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.224898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.225865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:20.226482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:20.315127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:20.318563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:20.324191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-20ed1af6-decb-4d99-8b3f-01b5f0a08741 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1204 microversion: 2.1 time: 0.111465 Jun 06 20:45:20.329645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:20.331168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:20.332885 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3f00292e-bdea-4bdd-b2f6-b9f7f3b15aa0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1796 microversion: 2.20 time: 0.183988 Jun 06 20:45:20.333601 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 175/359] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:45:20 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1796 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:45:20.334921 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 185/360] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:20 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:21.341375 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:21.341991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:21.348640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:21.349091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:21.349861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:21.350313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:21.500330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:21.508634 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fca0016d-9578-4c6f-9e71-90e27db895d2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.171065 Jun 06 20:45:21.509223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 176/361] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:21 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:21.667232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-33f0eeed-8aa4-4e3f-bdba-229c1bfcb872 req-87de0146-30c8-4604-a1eb-c80a3838123a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:21.679842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-33f0eeed-8aa4-4e3f-bdba-229c1bfcb872 req-87de0146-30c8-4604-a1eb-c80a3838123a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:21.680419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-33f0eeed-8aa4-4e3f-bdba-229c1bfcb872 req-87de0146-30c8-4604-a1eb-c80a3838123a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:21.702612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-33f0eeed-8aa4-4e3f-bdba-229c1bfcb872 req-87de0146-30c8-4604-a1eb-c80a3838123a service nova] Creating event network-changed:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:45:21.710755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-33f0eeed-8aa4-4e3f-bdba-229c1bfcb872 req-87de0146-30c8-4604-a1eb-c80a3838123a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045879 Jun 06 20:45:21.710755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 186/362] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:22.529726 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:22.535867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:22.536994 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:22.537458 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:22.538208 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:22.538635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:22.667367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:22.675146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-342391b7-819c-4ac8-b6d5-64b16b00ae95 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.149388 Jun 06 20:45:22.675723 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 177/363] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:22 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:22.756026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0322c21-2d1b-46fa-9687-7b55e1982ad1"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:22.757204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:22.767024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:22.767467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:22.768251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:22.768774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:23.007504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:23.495305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5d0dec85-f098-4271-b6ce-2801b73ac079 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743087 Jun 06 20:45:23.495937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 187/364] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:45:22 2022] POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:23.692478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:23.693087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:23.700088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:23.700540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:23.701674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:23.702120 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:23.837579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:23.845741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a61ce998-2612-4338-b421-c4c404a5aa9d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.157531 Jun 06 20:45:23.846328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 178/365] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:23 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:24.863926 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:24.864625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:24.870829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:24.871269 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:24.872062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:24.872495 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:25.004227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:25.011626 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dc3a1bae-06b3-4520-9e57-ba8982052fe8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.153139 Jun 06 20:45:25.012272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 188/366] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:24 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:26.028528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:26.029137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:26.031486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:26.037036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:26.037485 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:26.038247 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:26.038809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:26.168074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:26.176006 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0db6466c-a719-44bd-b512-25743ec2a6d9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.150959 Jun 06 20:45:26.179806 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 179/367] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:26 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:27.191930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:27.192557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:27.194499 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:27.195150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:27.200507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:27.200941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:27.207257 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:27.207257 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:27.333657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:27.341211 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9361c547-7031-47ba-bd4f-c232e6cc52cc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.153131 Jun 06 20:45:27.341799 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 189/368] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:27 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:27.693192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:27.693871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:27.700926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:27.701184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:27.701907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:27.702434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:27.732841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:27.829665 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'services' on Instance uuid 46cd0208-5f22-427d-95a0-100597554481 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:45:28.044762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2f60e1a1-5da3-44c6-8f55-a74908973631 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments/cecd6511-6834-4b15-b6bc-9c723d7b37d8" status: 202 len: 0 microversion: 2.1 time: 0.355379 Jun 06 20:45:28.045426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 180/369] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:45:27 2022] DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments/cecd6511-6834-4b15-b6bc-9c723d7b37d8 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:45:28.357743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:28.358342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:28.365254 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:28.365694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:28.366445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:28.366870 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:28.499607 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:28.507735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-12477fa1-4bbf-42a5-9085-965b893b5e21 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.153798 Jun 06 20:45:28.508305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 190/370] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:28 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:29.540237 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:29.541379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:29.548437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:29.548888 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:29.549709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:29.550144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:29.789925 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:29.797374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b5d23004-d603-4a0f-9b81-feb4c6fb2550 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.273053 Jun 06 20:45:29.799279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 181/371] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:29 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:30.814923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:30.815733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:30.829701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:30.832693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:30.832693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:30.832693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:31.060135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:31.061905 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:31.076473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:31.077097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:31.077386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:31.079129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:31.084236 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:31.087333 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a9179d27-6b4f-459e-979a-b1deb610e154 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.276308 Jun 06 20:45:31.088390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 191/372] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:30 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:31.119263 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'flavor' on Instance uuid eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:45:31.563468 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7265547a-5c8d-4d12-8eee-f19822ef02da tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/action" status: 200 len: 32 microversion: 2.1 time: 0.506967 Jun 06 20:45:31.565398 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 182/373] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:45:31 2022] POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 20:45:31.574606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:31.580829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:31.583996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:31.584664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:31.585824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:31.586424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:31.757816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:31.768783 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fd928e03-05d5-46a0-aba9-6fd49095cac2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.197996 Jun 06 20:45:31.769365 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 192/374] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:31 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:32.107635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:32.108527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:32.122983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.124174 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.124987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.125585 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.418238 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4c50d81c-7bc3-42be-92fd-2fa89fe35794 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:32.425547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c50d81c-7bc3-42be-92fd-2fa89fe35794 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.426231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4c50d81c-7bc3-42be-92fd-2fa89fe35794 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.460715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:32.471074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c839f6a2-ea85-45ef-ac7c-e0718787af32 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.369806 Jun 06 20:45:32.479846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 183/375] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:32 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:32.494309 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4c50d81c-7bc3-42be-92fd-2fa89fe35794 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Going to try to stop instance {{(pid=124579) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 20:45:32.683201 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4c50d81c-7bc3-42be-92fd-2fa89fe35794 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action" status: 202 len: 0 microversion: 2.1 time: 0.268552 Jun 06 20:45:32.683914 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 193/376] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:45:32 2022] POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:45:32.692052 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:32.693146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:32.718163 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.718693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.719472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.720746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.787982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:32.788898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:32.795695 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.796136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.796911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:32.799847 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:32.964378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:32.977253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4f0bbcf0-2ef0-4641-ab79-08fbfc70d63b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.289078 Jun 06 20:45:32.978229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 184/377] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:32 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:32.978805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:32.998101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2b4cf4c9-95da-47c2-95f7-cf9179011747 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.214585 Jun 06 20:45:32.998682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 194/378] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:32 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:33.139951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-1b9b6de4-794f-4e18-a0e0-7149d887c538 req-9a43cb81-7682-44c6-bd97-72db13ac0eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "name": "network-vif-plugged", "status": "completed", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:33.166715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1b9b6de4-794f-4e18-a0e0-7149d887c538 req-9a43cb81-7682-44c6-bd97-72db13ac0eed service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:33.167152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1b9b6de4-794f-4e18-a0e0-7149d887c538 req-9a43cb81-7682-44c6-bd97-72db13ac0eed service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:33.183181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-1b9b6de4-794f-4e18-a0e0-7149d887c538 req-9a43cb81-7682-44c6-bd97-72db13ac0eed service nova] Creating event network-vif-plugged:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:45:33.191310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-1b9b6de4-794f-4e18-a0e0-7149d887c538 req-9a43cb81-7682-44c6-bd97-72db13ac0eed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055655 Jun 06 20:45:33.192134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 185/379] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:33.489316 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:33.492089 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:33.496560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:33.497274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:33.497944 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:33.498373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:33.685168 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:33.696584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e5d88551-ca91-40a8-9b7a-8ab1503f5f49 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.211191 Jun 06 20:45:33.697038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 195/380] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:33 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:33.995446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:33.996203 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:34.003183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.003816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.004802 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.005237 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.017186 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:34.017902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:34.027745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.028262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.029282 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.029812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.145765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:34.153850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-08bbe680-3056-4c47-9480-a18c082c264c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.163156 Jun 06 20:45:34.154427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 186/381] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:33 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:34.199052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:34.207719 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7fac0579-8d4d-48b8-a92c-174a8c3370a2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.195212 Jun 06 20:45:34.208569 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 196/382] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:34 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:34.715145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:34.718239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:34.722944 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.723985 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.724904 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:34.725456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:34.881803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:34.890171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f91f3294-3ae3-492c-af50-f9a16da9aea9 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1259 microversion: 2.1 time: 0.180164 Jun 06 20:45:34.891143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 187/383] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:34 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:35.171187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:35.171750 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:35.179461 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.180047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:35.180853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.181288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:35.224676 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:35.225309 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:35.232446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.232895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:35.233687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.234159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:35.346683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:35.355076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ea9efbc8-782a-40e6-9f58-ce084060a3c4 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.187736 Jun 06 20:45:35.356180 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 197/384] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:35 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:35.380036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:35.388240 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9af4384f-aafd-4410-b9d2-4ec014fd340e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.167486 Jun 06 20:45:35.388905 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 188/385] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:35 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:35.912162 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:35.919925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:35.929714 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.930157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:35.930933 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:35.931365 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.090376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:36.101758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e68edc72-bf80-48f9-8fb4-eb54f7f9dacd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1444 microversion: 2.1 time: 0.197901 Jun 06 20:45:36.102341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 198/386] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:35 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1444 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:36.119040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:36.119595 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:36.126180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.126633 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.127608 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.128079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.373779 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:36.374553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:36.381596 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.382051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.382998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.383441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.531932 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:36.542224 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-10b6c0be-041d-4a41-a625-7cdbe5b5b416 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.172249 Jun 06 20:45:36.542998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 199/387] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:36 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:36.562808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:36.563984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:36.570419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.571104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.572162 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:36.572761 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:36.619286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:36.628795 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4b47fad4-de6c-4842-bad2-aab4aff16337 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1444 microversion: 2.1 time: 0.513680 Jun 06 20:45:36.632210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 189/388] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:36 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1444 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:36.858429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:36.866994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dc3e3656-3b71-4579-a775-1ae9cb2db1dc tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.307665 Jun 06 20:45:36.867948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 200/389] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:36 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:37.564782 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:37.565668 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:37.583528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:37.584011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:37.584786 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:37.585360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:37.822305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:37.834686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-644c328f-c072-44d1-ae0b-202dcc37c7ff tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.278646 Jun 06 20:45:37.835829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 190/390] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:37 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:37.886284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:37.887848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:37.898056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:37.899035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:37.900102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:37.900696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:38.312467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:38.323967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4069d005-49e8-436d-adb7-748f8487e6b7 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.442192 Jun 06 20:45:38.327457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 201/391] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:37 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:38.853622 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:38.855227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:38.872570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:38.875985 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:38.877177 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:38.881090 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:39.122891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:39.133569 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-72476e03-da91-4976-9a48-6f4f19021bc9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.285110 Jun 06 20:45:39.145236 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 191/392] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:38 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:39.344392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:39.345663 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:39.352152 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:39.359899 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:39.365490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:39.365490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:39.365490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:39.640793 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:39.653222 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:39.656897 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5dd1573e-3fb1-44d2-b40f-265f635e6c87 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.316233 Jun 06 20:45:39.658891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 202/393] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:39 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:39.924883 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-55307dc8-9191-4150-950a-a271bc58689b req-aeeb7686-37cd-4f67-be61-ee33778d6eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:39.939188 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-55307dc8-9191-4150-950a-a271bc58689b req-aeeb7686-37cd-4f67-be61-ee33778d6eb4 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:39.939624 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-55307dc8-9191-4150-950a-a271bc58689b req-aeeb7686-37cd-4f67-be61-ee33778d6eb4 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:39.951960 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-55307dc8-9191-4150-950a-a271bc58689b req-aeeb7686-37cd-4f67-be61-ee33778d6eb4 service nova] Creating event network-changed:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:45:39.957483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-55307dc8-9191-4150-950a-a271bc58689b req-aeeb7686-37cd-4f67-be61-ee33778d6eb4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037200 Jun 06 20:45:39.958358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 192/394] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:40.152058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:40.153467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:40.164082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:40.168678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:40.172055 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:40.174052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:40.511656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:40.525495 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c8ef8275-9b4d-4f41-8b62-f915aaeaf2a8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.377354 Jun 06 20:45:40.530153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 203/395] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:40 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:40.680544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:40.681450 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:40.692701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:40.694112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:40.696729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:40.697167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:40.871514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:40.887736 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-18aa5611-7ac7-4c17-945b-4c19cb96a839 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.216328 Jun 06 20:45:40.888544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 193/396] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:40 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:41.542315 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:41.543816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:41.549392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:41.549832 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:41.550625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:41.551067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:41.708673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:41.716301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4891b8d1-4e45-496d-ab7c-f0b461124857 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.177849 Jun 06 20:45:41.717060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 204/397] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:41 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:41.905497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:41.906254 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:41.910900 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:41.916839 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:41.917490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:41.919012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:41.919518 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:42.078304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:42.086792 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fa71160f-98cf-480e-aa0d-eaeab2d7e3e9 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.185228 Jun 06 20:45:42.090109 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 194/398] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:41 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:42.735983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:42.737189 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:42.746715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:42.747163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:42.748003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:42.748631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:42.882249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:45:42.882500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 20:45:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 20:45:42.939757 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:42.947691 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-006f3942-1b36-45f0-94d7-5cf699a9f819 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1679 microversion: 2.1 time: 0.215558 Jun 06 20:45:42.957180 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 205/399] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:42 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:43.111109 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:43.111758 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:43.145096 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:43.145551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:43.149027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:43.150152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:43.185215 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:45:43.407654 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:43.419427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c855c539-a15b-4876-93ae-cb1f0a4a7c97 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.316600 Jun 06 20:45:43.420640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 195/400] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:43 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:43.967589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:43.968735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:43.980749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:43.983527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:43.984519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:43.986860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.165765 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:44.175333 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b140db91-be79-4fc8-bb88-a2e2cc5831d3 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1656 microversion: 2.1 time: 0.211599 Jun 06 20:45:44.176617 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 206/401] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:43 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1656 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:44.192079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5e4632bc-f08b-41db-8be6-539d7816a4f9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:44.201431 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e4632bc-f08b-41db-8be6-539d7816a4f9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:44.202138 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5e4632bc-f08b-41db-8be6-539d7816a4f9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.267040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5e4632bc-f08b-41db-8be6-539d7816a4f9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Going to try to start instance {{(pid=124578) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 20:45:44.436594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:44.437573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:44.449143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5e4632bc-f08b-41db-8be6-539d7816a4f9 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action" status: 202 len: 0 microversion: 2.1 time: 0.260637 Jun 06 20:45:44.451012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 196/402] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:45:44 2022] POST /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:45:44.453514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:44.454743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.456264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:44.477150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.479980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:44.479980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:44.489726 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:44.490456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.491847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:44.492479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:44.692440 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:44.701693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c25f56b4-2fa7-45da-94ec-0b8ee1034587 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.268966 Jun 06 20:45:44.708440 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 207/403] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:44 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:44.799403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:44.812940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ae36d709-66a9-404c-92c3-4127e863e803 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1665 microversion: 2.1 time: 0.347036 Jun 06 20:45:44.814437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 197/404] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:44 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1665 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:45.729842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:45.731507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:45.740403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:45.741347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:45.742822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:45.743389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:45.831593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:45.835567 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:45.850045 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:45.850955 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:45.852054 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:45.852672 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:45.900815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:45.911370 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c736b177-f968-41e5-81cb-315e026cb895 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.184758 Jun 06 20:45:45.920355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 208/405] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:45 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:46.018655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:46.026351 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d5ceb766-1935-4e48-9fae-bb9db12e70f8 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1665 microversion: 2.1 time: 0.199967 Jun 06 20:45:46.028124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 198/406] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:45 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:46.929352 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:46.930700 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:46.939695 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:46.940484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:46.941515 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:46.942019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:47.052317 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:47.053621 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:47.061931 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:47.062730 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:47.063630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:47.064191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:47.114757 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:47.126009 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ae92fd77-87c0-4049-81ea-1f9506d2d401 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.200650 Jun 06 20:45:47.126809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 209/407] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:46 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:47.223347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:47.244107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-48371f0c-96e6-4106-88e4-5ba9b48c4f0b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1669 microversion: 2.1 time: 0.195576 Jun 06 20:45:47.255847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 199/408] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:47 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:48.144707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:48.145311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:48.153193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:48.153917 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:48.155003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:48.155457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:48.293400 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:48.303590 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2591606a-6b51-4ec4-9fd3-ca466a7bb0ac tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.163951 Jun 06 20:45:48.304258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 210/409] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:48 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:49.320907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:49.321715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:49.328110 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:49.328638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:49.330007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:49.330515 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:49.488473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:49.490217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7e7d08d8-9af1-41a0-83fb-238a3d4cccc5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.173052 Jun 06 20:45:49.490790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 200/410] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:49 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:50.506808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:50.508051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:50.515103 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:50.516024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:50.516224 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:50.516664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:50.673182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:50.681790 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-906787ab-dca9-45e6-bcbf-48dbf142ef0e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1735 microversion: 2.1 time: 0.178752 Jun 06 20:45:50.682373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 211/411] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:50 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:51.699369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:51.699906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:51.706881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:51.707328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:51.708128 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:51.708565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:51.836990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:51.844911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0a100b67-07b9-43d7-ab98-f8b78830c053 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1715 microversion: 2.1 time: 0.149408 Jun 06 20:45:51.846219 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 201/412] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:51 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:51.917449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5b25e1e9-c2bc-4632-b362-734d836a30ff tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'create', calling method: .version_select at 0x7fdaea3a2160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-777834900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbjKbo8dH0z94v2xu6JOxlhwcNdjWvZuwGU9JzDNSNfmfQtamAj6PAjDwlr0Uw34w2JQlc527psL+69yKU2+IJLsYFfn+/YCmkf2Sp8kDeon2OUETyCKjSgqgD7KhFnlQ=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:51.932094 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-5b25e1e9-c2bc-4632-b362-734d836a30ff tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Getting quotas for project 64507ac6234948fba1aa5c64216b7a1e. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:45:51.936049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-5b25e1e9-c2bc-4632-b362-734d836a30ff tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Getting quotas for user e826d6287bd34267b9614b94b1cd41e2 and project 64507ac6234948fba1aa5c64216b7a1e. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:45:51.953572 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:51.953998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:51.960417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:51.960861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:51.962973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:51.962973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.006389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5b25e1e9-c2bc-4632-b362-734d836a30ff tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.092857 Jun 06 20:45:52.007009 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 212/413] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:45:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:52.045497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] HTTP exception thrown: Cannot 'detach_volume' instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 while it is in vm_state rescued Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Request method failure captured: Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments/b0322c21-2d1b-46fa-9687-7b55e1982ad1 HTTP/1.1 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmauKKDC_pjMkLbjlQHnS_V0pO7S5z25CA25lTZCfKtnWZzDQ0PmQ1smF7PeF_kSgeBsGJtrS3clGfPhg5jpf_oFa9gJ-qILgOHN9u8sPawE023JzgJ3OZcl81kIfaX2ctg5buPM1qDtujGhvQYDvT3hPjnecxmf5L7wL_-8t7g3zRo Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:45:52.047161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffb14a29d13a483ba8733e0bb3a56a17", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: a10ffb60631240fdb6b4a69d6d7f73e2 Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:45:52.048603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Cannot 'detach_volume' instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 while it is in vm_state rescued Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'server_id': 'eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79', 'id': 'b0322c21-2d1b-46fa-9687-7b55e1982ad1'} Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:45:52.049334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 while it is in vm_state rescued Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 while it is in vm_state rescued Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:45:52.050598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Returning 409 to user: Cannot 'detach_volume' instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 while it is in vm_state rescued {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:45:52.051615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-023421fb-0403-419c-8e55-60bca2928870 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments/b0322c21-2d1b-46fa-9687-7b55e1982ad1" status: 409 len: 152 microversion: 2.1 time: 0.099020 Jun 06 20:45:52.051615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 202/414] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:45:51 2022] DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments/b0322c21-2d1b-46fa-9687-7b55e1982ad1 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 06 20:45:52.056429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1620771444", "imageRef": "ffeb7a49-321b-4c76-a077-4561154e102d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-777834900", "networks": [{"uuid": "1ae69b65-e24a-43e8-b225-b698567f31b1"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:52.057435 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:52.057972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:52.065392 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.065864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.075111 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.075111 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.107595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] validate_networks() for [('1ae69b65-e24a-43e8-b225-b698567f31b1', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:45:52.265443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6fea8665-0ae6-4607-82e2-2c42874cf643 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/action" status: 202 len: 0 microversion: 2.1 time: 0.211424 Jun 06 20:45:52.266369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 203/415] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:45:52 2022] POST /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:45:52.275074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:52.275943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:52.282710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.283117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.284147 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.284688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.424769 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:52.433100 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-aab438ae-7f3e-4c8f-b268-9099cb553e72 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1723 microversion: 2.1 time: 0.161995 Jun 06 20:45:52.433669 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 204/416] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:52 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:52.583142 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:45:52.583568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:45:52.584067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:45:52.584474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:45:52.584885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:45:52.593927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.594368 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.595188 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:52.596139 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:52.613692 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Getting quotas for project 64507ac6234948fba1aa5c64216b7a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:45:52.617647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Getting quotas for user e826d6287bd34267b9614b94b1cd41e2 and project 64507ac6234948fba1aa5c64216b7a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:45:52.628560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:45:52.630737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ffeb7a49-321b-4c76-a077-4561154e102d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:45:52.744279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1ed792e0-f842-4901-900f-935a8a5295d4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691760 Jun 06 20:45:52.745201 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 213/417] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:45:52.755176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d6a6bf9f-f5ac-44eb-9355-5e194a6b1cf4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:52.755924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d6a6bf9f-f5ac-44eb-9355-5e194a6b1cf4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:52.821687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d6a6bf9f-f5ac-44eb-9355-5e194a6b1cf4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:52.829046 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d6a6bf9f-f5ac-44eb-9355-5e194a6b1cf4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1258 microversion: 2.1 time: 0.077860 Jun 06 20:45:52.829714 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 205/418] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:52 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:53.450945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:53.451550 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:53.458880 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:53.459332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:53.460214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:53.460654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:53.587585 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:53.595654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-82bb92fd-015f-4276-8808-054a0dde167b tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1723 microversion: 2.1 time: 0.149162 Jun 06 20:45:53.596270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 214/419] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:53 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:53.846081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:53.846791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:53.854272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:53.854718 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:53.855514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:53.855973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:53.915433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:53.922825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4d316104-d3de-481d-ae6c-b7abb4934478 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1262 microversion: 2.1 time: 0.080610 Jun 06 20:45:53.926942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 206/420] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:53 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:54.613329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:54.614029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:54.620548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:54.620998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:54.621765 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:54.622205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:54.753130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:54.761132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c965e55c-2c42-4a60-975a-154971ac30bd tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1723 microversion: 2.1 time: 0.152118 Jun 06 20:45:54.761698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 215/421] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:54 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:45:54.940899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:54.941535 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:54.947979 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:54.948426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:54.949181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:54.949616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:55.007483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:55.014729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e4c70c48-ad3e-41f8-9620-5c0b2a64a7a3 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1254 microversion: 2.1 time: 0.078194 Jun 06 20:45:55.015283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 207/422] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:54 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1254 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:55.778307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:55.778909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:55.785325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:55.785763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:55.786516 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:55.786947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:55.912991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:55.921153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-047fa776-70f2-4c5e-b808-4ac9c3eab3d8 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1729 microversion: 2.1 time: 0.146653 Jun 06 20:45:55.921815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 216/423] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:55 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:55.937867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:55.942796 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:55.945316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:55.945761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:55.946507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:55.946940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:56.025832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4da82218-75b8-4adf-bb4e-18545cb908d4 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091817 Jun 06 20:45:56.026428 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 208/424] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:45:55 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:56.036528 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:56.036528 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:56.039067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:56.039506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:56.040293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:56.040721 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:56.368098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:56.376529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c878b3c3-4178-4f3c-a1cb-c3be631e01cb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1310 microversion: 2.1 time: 0.347867 Jun 06 20:45:56.377544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 217/425] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:56 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1310 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:57.395896 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:57.397947 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:57.418398 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:57.418398 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:57.418628 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:57.419203 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:57.446639 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-5371d6a2-1bed-4a52-a696-9ddcb2ef0201 req-022cf270-5981-4331-ab88-64ea8b1b2dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:57.470195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-5371d6a2-1bed-4a52-a696-9ddcb2ef0201 req-022cf270-5981-4331-ab88-64ea8b1b2dfa service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:57.478261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-5371d6a2-1bed-4a52-a696-9ddcb2ef0201 req-022cf270-5981-4331-ab88-64ea8b1b2dfa service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:57.513771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-5371d6a2-1bed-4a52-a696-9ddcb2ef0201 req-022cf270-5981-4331-ab88-64ea8b1b2dfa service nova] Creating event network-changed:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:45:57.521522 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-5371d6a2-1bed-4a52-a696-9ddcb2ef0201 req-022cf270-5981-4331-ab88-64ea8b1b2dfa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078935 Jun 06 20:45:57.522705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 218/426] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:45:57.666942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:57.680927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f09a687d-be01-47e9-9a8c-023f02c89420 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.290512 Jun 06 20:45:57.683708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 209/427] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:57 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:58.699288 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:58.700017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:58.706945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:58.707396 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:58.708180 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:58.708614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:58.850673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:45:58.858336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c065596f-789e-40ba-9674-c2118e01f303 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.163828 Jun 06 20:45:58.858888 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 219/428] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:58 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:45:59.560538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-df61a7e6-f0b0-4096-b83f-038cf53b3408 req-4a76badd-420b-4e42-8462-ed8b1c5cb97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:45:59.569930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-df61a7e6-f0b0-4096-b83f-038cf53b3408 req-4a76badd-420b-4e42-8462-ed8b1c5cb97c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:59.570402 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-df61a7e6-f0b0-4096-b83f-038cf53b3408 req-4a76badd-420b-4e42-8462-ed8b1c5cb97c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:59.581338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-df61a7e6-f0b0-4096-b83f-038cf53b3408 req-4a76badd-420b-4e42-8462-ed8b1c5cb97c service nova] Creating event network-changed:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:45:59.586310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-df61a7e6-f0b0-4096-b83f-038cf53b3408 req-4a76badd-420b-4e42-8462-ed8b1c5cb97c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029433 Jun 06 20:45:59.586898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 210/429] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:45:59.874282 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:45:59.874816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:45:59.881918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:59.883145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:45:59.884326 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:45:59.885082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:00.045548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:00.053777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-06f0f5ea-4750-45e1-bd00-760b5f176d5d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.183317 Jun 06 20:46:00.054351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 220/430] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:45:59 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:01.070821 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:01.071779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:01.078556 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:01.079010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:01.079887 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:01.080535 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:01.247228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:01.255031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fd6492d5-ff25-4707-af70-4916f1415f81 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.188344 Jun 06 20:46:01.255608 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 211/431] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:01 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:02.272422 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:02.273023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:02.279467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.279947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:02.280692 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.281144 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:02.410470 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:02.412865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:02.419536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-68198544-27fc-4889-908a-94c3f04dab43 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.150838 Jun 06 20:46:02.420149 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 221/432] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:02 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:02.844090 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:02.844768 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:02.847783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:02.852907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.881334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:02.881334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.881334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:02.881334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:02.883765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2715e418-0d6b-4838-8be0-fe75693424fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments/c6da6751-90fd-41e6-bf0b-ac144e3d45e1" status: 200 len: 194 microversion: 2.20 time: 0.043980 Jun 06 20:46:02.884330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 212/433] 10.222.0.41 () {60 vars in 1453 bytes} [Mon Jun 6 20:46:02 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments/c6da6751-90fd-41e6-bf0b-ac144e3d45e1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:46:02.956513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:02.957138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:02.961435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:02.962060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=10 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:02.966044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.966584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:02.967602 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:02.968137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:03.104449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lazy-loading 'services' on Instance uuid 2b0b8d95-6069-4aec-bb06-9371a5bfc63e {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:03.441847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:03.442365 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:03.448822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:03.449278 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:03.450061 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:03.450503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:03.601222 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:03.608466 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5daba2c2-3ba7-4e60-b206-f2be54589aec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.174632 Jun 06 20:46:03.615854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 213/434] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:03 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:03.684671 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-87385252-d5b6-4064-b412-6cea4fe1e6f7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments/c6da6751-90fd-41e6-bf0b-ac144e3d45e1" status: 202 len: 0 microversion: 2.20 time: 0.733559 Jun 06 20:46:03.689992 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 222/435] 10.222.0.41 () {60 vars in 1456 bytes} [Mon Jun 6 20:46:02 2022] DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments/c6da6751-90fd-41e6-bf0b-ac144e3d45e1 => generated 0 bytes in 735 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:46:03.694945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:03.695828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:03.703223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:03.703682 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:03.704447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:03.705037 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:03.736641 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-86e1012e-d9cc-4ee6-b390-1b4390497fb9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045247 Jun 06 20:46:03.741474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 214/436] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:46:03 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:46:04.628002 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:04.628616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:04.635133 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:04.638987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:04.638987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:04.638987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:04.751332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:04.752424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:04.760163 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:04.760702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:04.761990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:04.762563 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:04.797270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:04.797816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fb8c2c5c-3014-4de3-9d8c-9652aec6df3c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052115 Jun 06 20:46:04.798362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 215/437] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:46:04 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:46:04.807392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1306a0fd-0bc0-4522-97ca-8163eacea074 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.184844 Jun 06 20:46:04.807978 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 223/438] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:04 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:05.809126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:05.810034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:05.816918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:05.817367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:05.818156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:05.818591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:05.823717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:05.824366 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:05.830731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:05.831178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:05.831987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:05.832428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:05.847426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-024771d3-412e-4fcb-b194-d8b9cf9fc90d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Jun 06 20:46:05.848012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 216/439] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:46:05 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:46:05.959591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:05.966819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a6ca6220-a305-4bde-a461-1d630f8b8d74 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.146903 Jun 06 20:46:05.967376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 224/440] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:05 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:06.858445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:06.859374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:06.866260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:06.866707 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:06.867467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:06.867926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:06.912784 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-935923d5-cb97-45f5-a6af-818066632052 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058207 Jun 06 20:46:06.914564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 217/441] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:46:06 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:46:06.984072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:06.984663 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:06.992591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:06.993493 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:06.994484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:06.994925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:07.272589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:07.279825 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1a4868cb-71ba-4855-bec9-9e9d022c7350 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.299552 Jun 06 20:46:07.280389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 225/442] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:06 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:07.448890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2eccccb8-5bcd-42de-91cf-461106aedb45 req-92a61a63-d5eb-48da-9c04-6d47fd7098f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:07.457497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2eccccb8-5bcd-42de-91cf-461106aedb45 req-92a61a63-d5eb-48da-9c04-6d47fd7098f5 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:07.457938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2eccccb8-5bcd-42de-91cf-461106aedb45 req-92a61a63-d5eb-48da-9c04-6d47fd7098f5 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:07.472011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2eccccb8-5bcd-42de-91cf-461106aedb45 req-92a61a63-d5eb-48da-9c04-6d47fd7098f5 service nova] Creating event network-changed:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:46:07.479657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2eccccb8-5bcd-42de-91cf-461106aedb45 req-92a61a63-d5eb-48da-9c04-6d47fd7098f5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034986 Jun 06 20:46:07.480887 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 218/443] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:07.925905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:07.926869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:07.933758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:07.934141 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:07.934907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:07.935335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:07.966356 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dd2248d5-6ed5-466f-b5cc-362064c8e59f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044437 Jun 06 20:46:07.966951 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 226/444] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:46:07 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:08.027124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:08.027725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:08.034297 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.034748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.035503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.035953 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.060052 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:46:08.297096 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:08.297709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:08.304464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.307851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.307851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.307851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.324569 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a970b9dd-3ee5-4bd9-8009-0d71f21c8bcd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 204 len: 0 microversion: 2.20 time: 0.301373 Jun 06 20:46:08.325148 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 219/445] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 20:46:08 2022] DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 20:46:08.333891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:08.334833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:08.340829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.341512 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.342278 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:08.342874 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:08.474089 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:08.480517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:08.482036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:08.483182 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-09e8a3be-cf34-432e-8f47-cb234ab78a45 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.153798 Jun 06 20:46:08.483760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 220/446] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:08 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:46:08.496387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:08.504466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c252f57d-e16e-488d-a2b6-dcd3b2d1779c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.211143 Jun 06 20:46:08.505018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 227/447] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:08 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:09.502404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:09.502984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:09.509485 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:09.509930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:09.510686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:09.511121 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:09.521856 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:09.522453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:09.524883 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:09.529596 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:09.530039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:09.530819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:09.531214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:09.644161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:09.652027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:09.653511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:09.654645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8410f64e-95cf-43e8-958e-cd3e7a7e622b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.156721 Jun 06 20:46:09.655194 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 221/448] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:09 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:09.664213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:09.671773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c363770a-f1be-415f-b65b-6064f8065e22 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.154253 Jun 06 20:46:09.672316 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 228/449] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:09 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:10.672856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:10.673472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:10.680040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:10.680491 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:10.681244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:10.681678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:10.688099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:10.688706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:10.695091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:10.695512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:10.696302 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:10.696737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:10.813202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:10.821402 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:10.822967 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:10.824161 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-59e0c649-57cf-46bf-9a90-ad287b4997ec tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.155255 Jun 06 20:46:10.824919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 222/450] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:10 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:10.826978 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:10.834760 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1c5c2be4-12f8-408a-8aca-80ec463292a4 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.150415 Jun 06 20:46:10.835310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 229/451] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:10 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:11.843159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:11.843791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:11.850386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:11.850922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:11.851610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:11.852117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:11.852117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:11.852273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:11.859004 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:11.859458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:11.860311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:11.860802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:11.989896 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:11.998183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:11.999844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:12.005027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3a9a4f08-9dce-4f27-937a-8abef16e3cea tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1724 microversion: 2.20 time: 0.161870 Jun 06 20:46:12.005027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 223/452] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:11 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:12.134433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:12.143446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-eb2ac458-ef90-4637-976b-8f32a5b2cfdf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.295773 Jun 06 20:46:12.144168 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 230/453] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:11 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:12.528753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-f6c84e29-eb96-4ae2-8770-6de5a1d0905e req-36c80614-90d8-4185-a63c-42f8c7c60032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0b8d95-6069-4aec-bb06-9371a5bfc63e", "name": "network-vif-deleted", "tag": "1a6010b8-546e-4d47-ab65-f9d68011be7d"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:12.539925 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:12.542321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f6c84e29-eb96-4ae2-8770-6de5a1d0905e req-36c80614-90d8-4185-a63c-42f8c7c60032 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:12.542984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f6c84e29-eb96-4ae2-8770-6de5a1d0905e req-36c80614-90d8-4185-a63c-42f8c7c60032 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:12.562617 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-f6c84e29-eb96-4ae2-8770-6de5a1d0905e req-36c80614-90d8-4185-a63c-42f8c7c60032 service nova] Creating event network-vif-deleted:1a6010b8-546e-4d47-ab65-f9d68011be7d for instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e on hv-cinder-84487 Jun 06 20:46:12.571985 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-f6c84e29-eb96-4ae2-8770-6de5a1d0905e req-36c80614-90d8-4185-a63c-42f8c7c60032 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044577 Jun 06 20:46:12.571985 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 224/454] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:13.020114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:13.020925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:13.027998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:13.028514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:13.029571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:13.030376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:13.063943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:13.063943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:13.064216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lazy-loading 'fault' on Instance uuid 2b0b8d95-6069-4aec-bb06-9371a5bfc63e {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:13.108293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:13.116662 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:13.118632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:13.119829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-224de4d7-7c57-434e-97ad-65b629cb98b5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 200 len: 1372 microversion: 2.20 time: 0.104435 Jun 06 20:46:13.120389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 231/455] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:13 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:13.163358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:13.166373 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:13.174378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:13.174823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:13.176723 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:13.177433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:13.369251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:13.379225 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-71b2bb1b-0e52-4417-b52f-753a5b9877ec tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.221380 Jun 06 20:46:13.380040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 225/456] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:13 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:14.137554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:14.138191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:14.145779 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:14.146297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:14.147131 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:14.147595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:14.160657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e HTTP/1.1 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:46:14.162274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:46:14.163952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '2b0b8d95-6069-4aec-bb06-9371a5bfc63e'} Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:46:14.164756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:46:14.165997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:14.167066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:46:14.167066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aa32eeeb-de44-4386-a0af-b7962253a914 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 404 len: 111 microversion: 2.20 time: 0.030058 Jun 06 20:46:14.167066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 232/457] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:14 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:46:14.173107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-855aea37-f5e9-4f3f-83a4-b8eb06b763d4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '.version_select at 0x7fdaea27e4c0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:14.245611 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-855aea37-f5e9-4f3f-83a4-b8eb06b763d4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109419621" status: 204 len: 0 microversion: 2.20 time: 0.076339 Jun 06 20:46:14.246232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 226/458] 10.222.0.41 () {60 vars in 1261 bytes} [Mon Jun 6 20:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109419621 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 20:46:14.395926 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:14.396455 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:14.402433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:14.402879 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:14.403636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:14.404089 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:14.660919 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:14.669048 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-be15fd05-9ddb-4064-91bc-afebe603519c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.277023 Jun 06 20:46:14.670126 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 233/459] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:14 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:15.087462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-493bccb0-6304-4a01-b8f0-407a3616aae6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: .version_select at 0x7fdaea222ee0>, body: {"keypair": {"name": "tempest-keypair-1861571648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVb1whm6IxyAAxy6fB+iYQRJ98FrAaG0FpinDNky6Eq5DD05fF+YQY/SoothnNsvHchi91eRw2fOLHNNH7gyVy2tCMObMOtAkxE2Exp/xY7cN3aNZQzANgksVQOw3JrXQ=="}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:15.102448 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-493bccb0-6304-4a01-b8f0-407a3616aae6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'key_pairs'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:46:15.110257 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-493bccb0-6304-4a01-b8f0-407a3616aae6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for user 3d3896bd70dd43fe95f7125f9f4693a0 and project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'key_pairs'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:46:15.211936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-493bccb0-6304-4a01-b8f0-407a3616aae6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.128343 Jun 06 20:46:15.212559 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 227/460] 10.222.0.41 () {62 vars in 1199 bytes} [Mon Jun 6 20:46:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 20:46:15.239390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-d607aa11-51a9-4a37-b3ae-90bc3438987b req-3f453113-6925-4180-9722-7e4428865391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "name": "network-vif-plugged", "status": "completed", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:15.249686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-d607aa11-51a9-4a37-b3ae-90bc3438987b req-3f453113-6925-4180-9722-7e4428865391 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:15.250343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-d607aa11-51a9-4a37-b3ae-90bc3438987b req-3f453113-6925-4180-9722-7e4428865391 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:15.261480 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-d607aa11-51a9-4a37-b3ae-90bc3438987b req-3f453113-6925-4180-9722-7e4428865391 service nova] Creating event network-vif-plugged:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:46:15.266754 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-d607aa11-51a9-4a37-b3ae-90bc3438987b req-3f453113-6925-4180-9722-7e4428865391 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jun 06 20:46:15.267983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 234/461] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:15.686401 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:15.687011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:15.693606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:15.694279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:15.695051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:15.695489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:15.824817 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:15.832990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c56c6e01-0678-45b3-a13f-e073774e9801 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.150527 Jun 06 20:46:15.843062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 228/462] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:15 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:16.850431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:16.851153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:16.857386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:16.857830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:16.858581 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:16.859013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:17.056503 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:17.064412 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1593d8a5-e298-438f-8718-4d591fb7da1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1358 microversion: 2.1 time: 0.218643 Jun 06 20:46:17.064978 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 235/463] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:16 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:17.386667 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1586866319", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46b99f10-fa03-4d68-918b-dec225733498"}], "security_groups": [{"name": "tempest-securitygroup--257058673"}], "key_name": "tempest-keypair-1861571648", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:17.491273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] validate_networks() for [('46b99f10-fa03-4d68-918b-dec225733498', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:46:17.845353 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:46:17.845795 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:46:17.846266 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:46:17.846672 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:46:17.847108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:46:17.855687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:17.856145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:17.856927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:17.857353 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:17.873173 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:46:17.877575 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Getting quotas for user 3d3896bd70dd43fe95f7125f9f4693a0 and project 1e2a93c20b2e4ace88184d8b156a0575. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:46:17.888112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:46:17.890305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:46:18.017509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-651a5b0b-5cfa-488f-acf3-2b177eb458a3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.635581 Jun 06 20:46:18.018200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 229/464] 10.222.0.41 () {62 vars in 1187 bytes} [Mon Jun 6 20:46:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 06 20:46:18.028042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:18.028703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:18.083032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:18.083506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.083799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:18.090244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.090628 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.091390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.091566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.091849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.093066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.094158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5f79637b-1719-4410-9d2a-43c72576b648 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1282 microversion: 2.20 time: 0.069973 Jun 06 20:46:18.094930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 236/465] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:18 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:18.222741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.230464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b1fd1f15-589f-4dac-b0ca-3be638fd3c1a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1548 microversion: 2.1 time: 0.152525 Jun 06 20:46:18.231611 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 230/466] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:18 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:18.246989 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:18.247595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:18.254671 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.255640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.255877 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.256350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.385602 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.393445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-053ebf2d-2957-404c-8622-ad17b0c5390f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1548 microversion: 2.1 time: 0.150448 Jun 06 20:46:18.394007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 237/467] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:18 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:18.408972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:18.412434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.413188 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Searching by: {'deleted': False, 'project_id': '64507ac6234948fba1aa5c64216b7a1e'} {{(pid=124578) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 20:46:18.419684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.420239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.421021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.421454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.492213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:18.513363 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.multi_cell_list [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124578) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 20:46:18.606875 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7ce90921-5cf6-46a1-9e6e-b5c3842f255b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201550 Jun 06 20:46:18.607456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 231/468] 10.222.0.41 () {58 vars in 1124 bytes} [Mon Jun 6 20:46:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:18.618200 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:18.618830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:18.624958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.625338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.626088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:18.626543 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:18.751588 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:18.758931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f008dc56-ccaa-4d4a-bf71-f390a9c3cd5f tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1548 microversion: 2.1 time: 0.144578 Jun 06 20:46:18.759494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 238/469] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:18 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:19.116856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:19.117464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:19.123318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:19.123862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:19.124652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:19.125086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:19.187168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:19.196038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:19.197581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:19.198687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-39d01912-092b-45de-8978-82d6a4b74eee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1286 microversion: 2.20 time: 0.089422 Jun 06 20:46:19.199232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 232/470] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:19 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:20.216421 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:20.217026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:20.224084 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:20.227786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:20.227786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:20.227786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:20.306383 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:20.308669 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:20.315067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:20.316631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:20.317721 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-829328c6-c641-400c-8cc9-cc159a8c47c0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1352 microversion: 2.20 time: 0.105226 Jun 06 20:46:20.318459 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 239/471] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:20 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:20.632608 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aca9f3e-fb03-41a1-be00-8cd87c24aba3"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:20.633667 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:20.640243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:20.640957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:20.641722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:20.642649 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:21.300441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-aa595f76-6453-43c0-8bea-3a55feb6741a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671947 Jun 06 20:46:21.301313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 233/472] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:46:20 2022] POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:21.336686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:21.338523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:21.348800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:21.348800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:21.348800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:21.348800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:21.525114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:21.533647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:21.535148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:21.536281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c8d3ff97-3ade-4712-add1-596ef0e472be tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.205235 Jun 06 20:46:21.536836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 240/473] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:21 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:21.892839 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-b8f7b03a-7f36-4961-878d-92a72c0ccddf req-92bb2a9b-2147-437b-b1c0-e492f1a47a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:21.904497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-b8f7b03a-7f36-4961-878d-92a72c0ccddf req-92bb2a9b-2147-437b-b1c0-e492f1a47a3b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:21.905021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-b8f7b03a-7f36-4961-878d-92a72c0ccddf req-92bb2a9b-2147-437b-b1c0-e492f1a47a3b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:21.916753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-b8f7b03a-7f36-4961-878d-92a72c0ccddf req-92bb2a9b-2147-437b-b1c0-e492f1a47a3b service nova] Creating event network-changed:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:46:21.921805 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-b8f7b03a-7f36-4961-878d-92a72c0ccddf req-92bb2a9b-2147-437b-b1c0-e492f1a47a3b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Jun 06 20:46:21.922487 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 234/474] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:46:22.554204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:22.554808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:22.561736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:22.562176 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:22.562935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:22.563365 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:22.710044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:22.717881 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:22.719362 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:22.720504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-292d2286-dcb8-460e-bd02-a70a64c0c6dd tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.170175 Jun 06 20:46:22.721049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 241/475] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:22 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:23.739073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:23.739806 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:23.746007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:23.746452 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:23.747204 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:23.747639 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:23.875647 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:23.884059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:23.886016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:23.886641 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a59c031f-e239-4666-9412-ad8f63ce4dce tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.152274 Jun 06 20:46:23.887208 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 235/476] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:23 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:24.905202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:24.905762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:24.912011 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:24.912458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:24.913224 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:24.913656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:25.042261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:25.055231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:25.056762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:25.057854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-40a026ab-72ae-43cf-a434-25661363e54a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.156622 Jun 06 20:46:25.058407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 242/477] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:24 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:26.076170 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:26.076930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:26.084146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:26.084689 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:26.085452 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:26.085881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:26.209783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:26.217678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:26.219206 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:26.220880 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-dafdd2d4-1938-4e49-b454-389921ecaaee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.148635 Jun 06 20:46:26.221434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 236/478] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:26 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:27.238524 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:27.239161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:27.245794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:27.246241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:27.247050 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:27.247479 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:27.375963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:27.378064 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2b827893-ae21-4546-8f40-d215cbedb3b4 req-c4e400b1-2a27-457e-9049-0ca271912957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "name": "network-vif-plugged", "status": "completed", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:27.385196 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:27.386687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2b827893-ae21-4546-8f40-d215cbedb3b4 req-c4e400b1-2a27-457e-9049-0ca271912957 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:27.386810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:27.387133 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2b827893-ae21-4546-8f40-d215cbedb3b4 req-c4e400b1-2a27-457e-9049-0ca271912957 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:27.387818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-10bc9f03-021e-4e2b-b194-661ee7a72c9d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.153216 Jun 06 20:46:27.388371 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 243/479] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:27 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:27.398580 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2b827893-ae21-4546-8f40-d215cbedb3b4 req-c4e400b1-2a27-457e-9049-0ca271912957 service nova] Creating event network-vif-plugged:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:46:27.403407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2b827893-ae21-4546-8f40-d215cbedb3b4 req-c4e400b1-2a27-457e-9049-0ca271912957 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028807 Jun 06 20:46:27.403971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 237/480] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:46:28.406494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:28.407126 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:28.409105 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:28.414386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:28.414839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:28.415964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:28.416399 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:28.546190 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:28.554023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:28.555731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:28.556828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a2129262-a404-419e-85b5-d3de5fdc4805 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.154329 Jun 06 20:46:28.557379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 244/481] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:28 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:28.835020 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=10 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:28.836307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=4 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:28.840291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:28.840993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:28.847312 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:28.847826 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:28.848555 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:28.848991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:28.979417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:28.988056 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9e94d43a-989b-4cb3-8f6c-0d2dd41f4006 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1594 microversion: 2.1 time: 0.153946 Jun 06 20:46:28.988626 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 238/482] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:28 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:29.575512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:29.576278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:29.583102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:29.583547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:29.584388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:29.584823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:29.719325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:29.727857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:29.729328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:29.730442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-02a6ba0e-1123-45b6-9663-350c8323e6d7 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1407 microversion: 2.20 time: 0.159072 Jun 06 20:46:29.731000 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 245/483] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:29 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:30.040052 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:30.041036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:30.047195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.047638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.048511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.048940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.077553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f9021089-4e22-4eef-b0f0-56546d2cf3d2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041439 Jun 06 20:46:30.078104 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 239/484] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:46:30 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:46:30.138777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:30.139381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:30.145609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.146135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.146956 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.147386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.174064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Going to try to terminate instance {{(pid=124579) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:46:30.427506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ee7cb7fe-b83c-4409-9b83-5247853d3005 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 204 len: 0 microversion: 2.1 time: 0.291991 Jun 06 20:46:30.428236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 246/485] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:46:30 2022] DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:46:30.436482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:30.437167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:30.443891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.444339 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.445116 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.445549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.680551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:30.688070 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a1ff9377-2693-4c42-aab9-2821772d05a2 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1675 microversion: 2.1 time: 0.255457 Jun 06 20:46:30.688663 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 240/486] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:30 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:30.748986 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:30.749673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:30.756074 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.756519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.757287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.757717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.891132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:30.900088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:30.901563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:30.902713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-388d9688-bbd0-44c1-9442-f590e8af6014 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1599 microversion: 2.20 time: 0.158072 Jun 06 20:46:30.903481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 247/487] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:46:30 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:46:30.920936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:30.921434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:30.927721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.928237 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:30.928925 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:30.929355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:31.077296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fde582de-e8a5-4ca0-9c3d-dd7428381ce9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160229 Jun 06 20:46:31.077915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 241/488] 10.222.0.41 () {60 vars in 1315 bytes} [Mon Jun 6 20:46:30 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:46:31.355452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-ae42119b-596d-42e2-ad10-30fcb9755d8c req-a8d1efb6-210b-4146-8cd2-927f48f40b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:31.365408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ae42119b-596d-42e2-ad10-30fcb9755d8c req-a8d1efb6-210b-4146-8cd2-927f48f40b37 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:31.365856 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ae42119b-596d-42e2-ad10-30fcb9755d8c req-a8d1efb6-210b-4146-8cd2-927f48f40b37 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:31.388774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-ae42119b-596d-42e2-ad10-30fcb9755d8c req-a8d1efb6-210b-4146-8cd2-927f48f40b37 service nova] Creating event network-changed:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:46:31.400565 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-ae42119b-596d-42e2-ad10-30fcb9755d8c req-a8d1efb6-210b-4146-8cd2-927f48f40b37 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048562 Jun 06 20:46:31.401187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 248/489] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:31.707926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:31.709066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:31.722336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:31.722336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:31.722336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:31.722336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:31.897854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:31.910564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b22ca025-a4fa-4873-9462-fa7d57fee8f1 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1675 microversion: 2.1 time: 0.208459 Jun 06 20:46:31.911383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 242/490] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:31 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:32.140872 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-0db3f525-2920-4ecf-949f-45d6228b4af6 req-095d10a3-89ad-4b7d-8b6d-9441f3501f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:32.150583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-0db3f525-2920-4ecf-949f-45d6228b4af6 req-095d10a3-89ad-4b7d-8b6d-9441f3501f99 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:32.151284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-0db3f525-2920-4ecf-949f-45d6228b4af6 req-095d10a3-89ad-4b7d-8b6d-9441f3501f99 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:32.164329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-0db3f525-2920-4ecf-949f-45d6228b4af6 req-095d10a3-89ad-4b7d-8b6d-9441f3501f99 service nova] Creating event network-changed:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:46:32.173805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-0db3f525-2920-4ecf-949f-45d6228b4af6 req-095d10a3-89ad-4b7d-8b6d-9441f3501f99 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Jun 06 20:46:32.174924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 249/491] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:32.932497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:32.934723 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:32.944246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:32.945052 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:32.946218 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:32.946863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:33.266255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:33.274464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e4fc6191-bfc7-41d3-9f4f-4cc57808107e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1675 microversion: 2.1 time: 0.348938 Jun 06 20:46:33.275033 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 243/492] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:32 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1675 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:33.821348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-24a62c0d-9abf-4062-b644-fbe09777e429 req-5a5a19c8-589f-4cae-bd8d-9d7c0521f858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cd0208-5f22-427d-95a0-100597554481", "name": "network-vif-deleted", "tag": "0fccccb6-9c44-4b23-8b78-dc4ba9b583dd"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:33.832950 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-24a62c0d-9abf-4062-b644-fbe09777e429 req-5a5a19c8-589f-4cae-bd8d-9d7c0521f858 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:33.833387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-24a62c0d-9abf-4062-b644-fbe09777e429 req-5a5a19c8-589f-4cae-bd8d-9d7c0521f858 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:33.845734 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-24a62c0d-9abf-4062-b644-fbe09777e429 req-5a5a19c8-589f-4cae-bd8d-9d7c0521f858 service nova] Creating event network-vif-deleted:0fccccb6-9c44-4b23-8b78-dc4ba9b583dd for instance 46cd0208-5f22-427d-95a0-100597554481 on hv-cinder-84487 Jun 06 20:46:33.851567 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-24a62c0d-9abf-4062-b644-fbe09777e429 req-5a5a19c8-589f-4cae-bd8d-9d7c0521f858 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Jun 06 20:46:33.852292 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 250/493] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:34.220927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-137922671"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:34.221549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:34.228249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.229097 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.229937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.230433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.298402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:34.299934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:34.306252 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.311281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.311281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.311281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.339619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.340506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.340623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'fault' on Instance uuid 46cd0208-5f22-427d-95a0-100597554481 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:34.385204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:34.389352 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.network.security_group_api [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Adding security group b717f32e-b872-455f-9652-68ec84efa1c7 to port fe264bdd-5f81-4d3b-97d0-61b06b165535 Jun 06 20:46:34.396793 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9b63adbb-4346-43d1-ad8a-e6b3efa36321 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 200 len: 1328 microversion: 2.1 time: 0.102618 Jun 06 20:46:34.397697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 251/494] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:34 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:34.869042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ba2add90-3dbb-4910-8cde-5a53b9304b3a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action" status: 202 len: 0 microversion: 2.1 time: 0.652605 Jun 06 20:46:34.869684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 244/495] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:46:34 2022] POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:46:34.878708 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:34.879946 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:34.890941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.891223 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:34.892524 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:34.892960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.076047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:35.084751 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1d93f50b-a3ad-4af1-b31a-89545a447247 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1759 microversion: 2.1 time: 0.210258 Jun 06 20:46:35.085239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 252/496] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:34 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:35.347038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:35.347596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:35.354536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.355178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.355975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.356441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.414237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:35.414840 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:35.420964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.421525 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.422242 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.423618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.439507 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 HTTP/1.1 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:46:35.441161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:46:35.442752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '46cd0208-5f22-427d-95a0-100597554481'} Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:46:35.445202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:46:35.446767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:35.448068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:46:35.448068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-364b8e90-6680-4f77-a8c7-456570090396 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 404 len: 111 microversion: 2.1 time: 0.032184 Jun 06 20:46:35.448068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 253/497] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:35 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:46:35.450408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'services' on Instance uuid eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:35.451284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9a4218f2-4d96-46ca-ae7d-e7e5c2e84628 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '.version_select at 0x7fdaea32e160>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:35.520021 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9a4218f2-4d96-46ca-ae7d-e7e5c2e84628 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395729434" status: 202 len: 0 microversion: 2.1 time: 0.071860 Jun 06 20:46:35.520728 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 254/498] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 20:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395729434 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:46:35.671895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c4631624-e1d9-4f09-902a-b45df2c7dfd3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments/b0322c21-2d1b-46fa-9687-7b55e1982ad1" status: 202 len: 0 microversion: 2.1 time: 0.329095 Jun 06 20:46:35.672582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 245/499] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:46:35 2022] DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments/b0322c21-2d1b-46fa-9687-7b55e1982ad1 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:46:35.681447 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:35.682439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:35.689218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.689669 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.690430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.690863 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.718343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-36c157da-8b2c-4aed-82ea-92b5e181f086 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 Jun 06 20:46:35.718894 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 255/500] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:46:35 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:35.871750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-a0cea4fe-7aae-41a4-acdd-5084f28c1fc7 req-17febdc7-b401-474f-813d-234ffef684ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:35.880019 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a0cea4fe-7aae-41a4-acdd-5084f28c1fc7 req-17febdc7-b401-474f-813d-234ffef684ec service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:35.880472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a0cea4fe-7aae-41a4-acdd-5084f28c1fc7 req-17febdc7-b401-474f-813d-234ffef684ec service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:35.891542 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-a0cea4fe-7aae-41a4-acdd-5084f28c1fc7 req-17febdc7-b401-474f-813d-234ffef684ec service nova] Creating event network-changed:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:46:35.896812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-a0cea4fe-7aae-41a4-acdd-5084f28c1fc7 req-17febdc7-b401-474f-813d-234ffef684ec service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029140 Jun 06 20:46:35.897403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 246/501] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:36.389127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-843d2b36-1ed9-49e7-ac20-2ffae4357f3d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: .version_select at 0x7fdaea3a2b80>, body: {"keypair": {"name": "tempest-keypair-2117475891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5yFGXL8pc7+JOXRMXsknHZgSrDWZGeys/TPtlUMLO3xMoizCrY27qy3RG/xjUEYQV6X0V+BRJmprMdfBca0grU447L+v4zy4S10R9Oq2Jil2g8UV5v/2FBwyJ+WUZUdQ=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:36.404556 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-843d2b36-1ed9-49e7-ac20-2ffae4357f3d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for project 3a1af880b45d426aa752589183354a77. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:46:36.409024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-843d2b36-1ed9-49e7-ac20-2ffae4357f3d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for user a47ab3ebbc9a4a429e5df2a616f305f0 and project 3a1af880b45d426aa752589183354a77. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:46:36.514162 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-843d2b36-1ed9-49e7-ac20-2ffae4357f3d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128779 Jun 06 20:46:36.514804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 256/502] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:46:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:36.731454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:36.732490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:36.738774 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:36.739228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:36.740018 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:36.740455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:36.777249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e4197060-862f-4cd4-bc69-2fa35cd920c0 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Jun 06 20:46:36.777249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 247/503] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:46:36 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:37.783969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:37.784908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:37.792039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:37.792481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:37.793245 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:37.793685 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:37.821341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aceb63b0-f34f-42d9-86c1-6c05eb929a74 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041408 Jun 06 20:46:37.821891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 257/504] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:46:37 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:46:37.887439 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:37.888023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:37.895132 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:37.895579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:37.896371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:37.896900 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:37.901141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:37.924223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:46:38.199023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-536082c6-1b6e-4401-a398-7d29693bf028 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 204 len: 0 microversion: 2.1 time: 0.314967 Jun 06 20:46:38.199631 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 248/505] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:46:37 2022] DELETE /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:46:38.211127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:38.211763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:38.227641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:38.228137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:38.228906 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:38.229517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:38.452416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:38.459822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e8b3dc66-5aaf-403e-bd52-bbbe40900517 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1689 microversion: 2.1 time: 0.252399 Jun 06 20:46:38.460381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 258/506] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:38 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:39.023328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-784112282", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbae566b-f7e0-4501-b7f1-3ce574ab7b06"}], "security_groups": [{"name": "tempest-securitygroup--417164785"}], "key_name": "tempest-keypair-2117475891", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:39.121967 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] validate_networks() for [('bbae566b-f7e0-4501-b7f1-3ce574ab7b06', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:46:39.476840 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:39.478349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:39.484137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:39.487983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:39.487983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:39.487983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:39.490704 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:39.626648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:39.634114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-751b00a5-79a0-454d-92d8-f3306a0701c5 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1689 microversion: 2.1 time: 0.161075 Jun 06 20:46:39.634686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 259/507] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:39 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:39.697581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:46:39.697998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:46:39.698467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:46:39.698890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:46:39.699294 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:46:39.708467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:39.708902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:39.709684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:39.710117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:39.726520 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for project 3a1af880b45d426aa752589183354a77. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:46:39.730498 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Getting quotas for user a47ab3ebbc9a4a429e5df2a616f305f0 and project 3a1af880b45d426aa752589183354a77. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:46:39.741156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:46:39.743410 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:46:39.793305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:39.863295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3c05284d-9d86-45ea-b5d8-9f7fdc4c2d9f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.844545 Jun 06 20:46:39.863982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 249/508] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:46:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:46:39.874017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ed3a87e5-6528-4a53-9d0d-875ac8afc209 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:39.874625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ed3a87e5-6528-4a53-9d0d-875ac8afc209 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:39.876987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:39.927912 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ed3a87e5-6528-4a53-9d0d-875ac8afc209 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:39.935128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ed3a87e5-6528-4a53-9d0d-875ac8afc209 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1237 microversion: 2.1 time: 0.064960 Jun 06 20:46:39.935890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 260/509] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:39 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:40.651218 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:40.651883 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:40.659956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:40.660400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:40.661155 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:40.661584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:40.790272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:40.797607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-20d6f952-2a46-471a-b80e-2ba61830cd92 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1689 microversion: 2.1 time: 0.150362 Jun 06 20:46:40.798915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 250/510] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:40 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:40.952331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:40.952940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:40.959704 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:40.960140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:40.960900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:40.961332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:41.021579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:41.028948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aabf8d0d-71f6-46cd-ac7b-6ec3c87baac6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1241 microversion: 2.1 time: 0.080459 Jun 06 20:46:41.029509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 261/511] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:40 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:41.815450 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:41.816210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:41.822924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:41.823447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:41.824302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:41.824858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:42.046101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:42.046717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:42.054011 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:42.054458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:42.055222 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:42.055654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:42.066550 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:42.075303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1bb83727-afd4-488f-9dfd-784561d51104 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1689 microversion: 2.1 time: 0.263715 Jun 06 20:46:42.076190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 251/512] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:41 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:42.122439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:42.130945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ea82b411-25c4-4abb-b965-d6c53247c3cf tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1289 microversion: 2.1 time: 0.088618 Jun 06 20:46:42.131506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 262/513] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:42 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:42.568305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-f434046c-fd0c-4c49-b5b6-5a8fa073f094 req-115acd46-8807-4a98-aa93-69f37405cd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79", "name": "network-vif-deleted", "tag": "6cbb9c3f-490d-43d3-aea8-a575dbdd6f71"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:42.576883 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f434046c-fd0c-4c49-b5b6-5a8fa073f094 req-115acd46-8807-4a98-aa93-69f37405cd4d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:42.577326 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f434046c-fd0c-4c49-b5b6-5a8fa073f094 req-115acd46-8807-4a98-aa93-69f37405cd4d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:42.589726 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-f434046c-fd0c-4c49-b5b6-5a8fa073f094 req-115acd46-8807-4a98-aa93-69f37405cd4d service nova] Creating event network-vif-deleted:6cbb9c3f-490d-43d3-aea8-a575dbdd6f71 for instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 on hv-cinder-84487 Jun 06 20:46:42.596358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-f434046c-fd0c-4c49-b5b6-5a8fa073f094 req-115acd46-8807-4a98-aa93-69f37405cd4d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Jun 06 20:46:42.597486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 252/514] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:43.093005 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:43.093601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:43.100076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:43.100619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:43.101319 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:43.101776 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:43.141513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:43.142757 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:43.143543 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'fault' on Instance uuid eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:43.153258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:43.154691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:43.163400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:43.166823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:43.166823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:43.166823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:43.225839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:43.270085 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f960273d-74c7-49a2-9f4e-dc9450306ad2 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 200 len: 1335 microversion: 2.1 time: 0.179613 Jun 06 20:46:43.272408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 263/515] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:43 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:43.390999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:43.399975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ec189ae5-9d7e-47d7-9e43-d4f9041e982e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.254539 Jun 06 20:46:43.404117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 253/516] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:43 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:44.152070 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-bdfffd11-09be-42ec-bae5-cd8b08d604dc req-06f14ba0-adb7-4feb-b181-cdce18c7295d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a253f5a-4a96-4b83-b854-a41081156f1f", "tag": "023f96ea-b1c9-42a8-b7df-1571b32ec938"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:44.161453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-bdfffd11-09be-42ec-bae5-cd8b08d604dc req-06f14ba0-adb7-4feb-b181-cdce18c7295d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:44.161453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-bdfffd11-09be-42ec-bae5-cd8b08d604dc req-06f14ba0-adb7-4feb-b181-cdce18c7295d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:44.175390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-bdfffd11-09be-42ec-bae5-cd8b08d604dc req-06f14ba0-adb7-4feb-b181-cdce18c7295d service nova] Creating event network-changed:023f96ea-b1c9-42a8-b7df-1571b32ec938 for instance 4a253f5a-4a96-4b83-b854-a41081156f1f on hv-cinder-84487 Jun 06 20:46:44.181945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-bdfffd11-09be-42ec-bae5-cd8b08d604dc req-06f14ba0-adb7-4feb-b181-cdce18c7295d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033807 Jun 06 20:46:44.182855 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 264/517] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:44.286389 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:44.287062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:44.293716 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:44.294164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:44.294970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:44.295424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:44.309926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] HTTP exception thrown: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Request method failure captured: Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 HTTP/1.1 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmauKKDC_pjMkLbjlQHnS_V0pO7S5z25CA25lTZCfKtnWZzDQ0PmQ1smF7PeF_kSgeBsGJtrS3clGfPhg5jpf_oFa9gJ-qILgOHN9u8sPawE023JzgJ3OZcl81kIfaX2ctg5buPM1qDtujGhvQYDvT3hPjnecxmf5L7wL_-8t7g3zRo Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:46:44.311552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffb14a29d13a483ba8733e0bb3a56a17", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: a10ffb60631240fdb6b4a69d6d7f73e2 Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. Jun 06 20:46:44.313342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': 'eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79'} Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:46:44.317902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. Jun 06 20:46:44.319296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:44.320578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Returning 404 to user: Instance eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:46:44.320578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3b097663-8e10-4ea9-9ce5-6e452adfeb32 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jun 06 20:46:44.320578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 254/518] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:44 2022] GET /compute/v2.1/servers/eb78c1f0-42b8-4e2d-b0b4-27e83c13ab79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:46:44.322798 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9fb64337-e6f0-44eb-a731-aa1ea1595c27 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '.version_select at 0x7fdaea3a2550>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:44.405248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9fb64337-e6f0-44eb-a731-aa1ea1595c27 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254335622" status: 202 len: 0 microversion: 2.1 time: 0.086491 Jun 06 20:46:44.405864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 265/519] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 20:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254335622 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:46:44.417499 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:44.418108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:44.424869 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:44.425298 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:44.426058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:44.426484 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:44.563022 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:44.570441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d4132797-164b-4409-91b0-def358d9ebf6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.156820 Jun 06 20:46:44.570998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 255/520] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:44 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:45.588114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:45.588842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:45.594961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:45.595414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:45.596870 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:45.597310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:45.729762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:45.737193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-50abe2bf-cb14-4224-8e74-f2736b02e1da tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.153620 Jun 06 20:46:45.737735 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 266/521] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:45 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:46.753727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:46.754379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:46.760793 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:46.761259 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:46.762008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:46.762439 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:46.890778 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:46.898272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a35c5525-7cd4-4831-a080-bef8f83d4b96 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.148344 Jun 06 20:46:46.898833 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 256/522] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:46 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:47.914808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:47.915519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:47.922069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:47.922520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:47.923286 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:47.924317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:48.050433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:48.057839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5acf1844-fb29-4ffc-bdc9-83d3b02071fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.146796 Jun 06 20:46:48.058344 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 267/523] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:47 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:48.135465 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:48.136008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:48.142646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:48.143097 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:48.143917 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:48.144354 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:48.168787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:46:48.438342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ead81cb3-80d5-457a-93f5-696f1fe8e09d tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 204 len: 0 microversion: 2.1 time: 0.306299 Jun 06 20:46:48.438918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 257/524] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:46:48 2022] DELETE /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:46:48.446753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:48.448293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:48.454394 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:48.454836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:48.456138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:48.456563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:48.583601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:48.591113 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5523647b-3157-47a9-a364-b987c52ad77a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1506 microversion: 2.1 time: 0.148024 Jun 06 20:46:48.591705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 268/525] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:48 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:49.075703 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:49.076403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:49.083134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:49.083584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:49.084570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:49.085010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:49.213943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:49.221382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-01de5194-57c2-4bf1-a495-d4f6c004e9de tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.149900 Jun 06 20:46:49.221946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 258/526] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:49 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:49.503774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-60531819-2546-4ca6-a7fd-da83e9590a7a req-b7ee2754-0fd3-4a40-9f23-e769f4f46d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a253f5a-4a96-4b83-b854-a41081156f1f", "name": "network-vif-plugged", "status": "completed", "tag": "023f96ea-b1c9-42a8-b7df-1571b32ec938"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:49.512329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-60531819-2546-4ca6-a7fd-da83e9590a7a req-b7ee2754-0fd3-4a40-9f23-e769f4f46d3c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:49.512769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-60531819-2546-4ca6-a7fd-da83e9590a7a req-b7ee2754-0fd3-4a40-9f23-e769f4f46d3c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:49.523783 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-60531819-2546-4ca6-a7fd-da83e9590a7a req-b7ee2754-0fd3-4a40-9f23-e769f4f46d3c service nova] Creating event network-vif-plugged:023f96ea-b1c9-42a8-b7df-1571b32ec938 for instance 4a253f5a-4a96-4b83-b854-a41081156f1f on hv-cinder-84487 Jun 06 20:46:49.528631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-60531819-2546-4ca6-a7fd-da83e9590a7a req-b7ee2754-0fd3-4a40-9f23-e769f4f46d3c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Jun 06 20:46:49.535053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 269/527] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:49.608653 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:49.609351 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:49.616445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:49.618158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:49.618158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:49.618158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:49.717888 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:49.737447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=6 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:49.745756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:49.753711 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5fbbb530-53a5-40d4-a798-269f20b2907f tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1506 microversion: 2.1 time: 0.148930 Jun 06 20:46:49.754271 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 259/528] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:49 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:50.235424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:50.239570 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:50.240294 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:50.246478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:50.252066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:50.252066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:50.252066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:50.374086 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:50.382092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-77b8ecfd-8809-43ce-a892-053a42ccf860 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.147581 Jun 06 20:46:50.382652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 270/529] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:50 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:50.770767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:50.771396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:50.778461 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:50.778918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:50.779707 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:50.780148 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:50.909016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:50.916487 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a781f033-6db3-4408-9c6c-1530ac622868 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1506 microversion: 2.1 time: 0.149833 Jun 06 20:46:50.917044 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 260/530] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:50 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:46:51.399451 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:51.400084 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:51.406428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.406868 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.407613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.408618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.524949 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-36c23813-14ce-4aee-b718-153894c0e1d3 req-4d3e8536-5e53-41fd-85a6-337b400888fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a1e290-4870-4dff-a043-14915d563e75", "name": "network-vif-deleted", "tag": "dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:51.534450 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-36c23813-14ce-4aee-b718-153894c0e1d3 req-4d3e8536-5e53-41fd-85a6-337b400888fb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.534963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-36c23813-14ce-4aee-b718-153894c0e1d3 req-4d3e8536-5e53-41fd-85a6-337b400888fb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.548792 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-36c23813-14ce-4aee-b718-153894c0e1d3 req-4d3e8536-5e53-41fd-85a6-337b400888fb service nova] Creating event network-vif-deleted:dfcc0cbf-f1fd-48bc-956b-24fbdd5e5601 for instance 43a1e290-4870-4dff-a043-14915d563e75 on hv-cinder-84487 Jun 06 20:46:51.549944 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:51.556000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-36c23813-14ce-4aee-b718-153894c0e1d3 req-4d3e8536-5e53-41fd-85a6-337b400888fb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035356 Jun 06 20:46:51.561995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c063e4ef-a11c-43a4-9601-b0ff6114a7d7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1362 microversion: 2.1 time: 0.163256 Jun 06 20:46:51.562106 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 261/531] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:46:51.562205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 271/532] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:51 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:51.935564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:51.936295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:51.943083 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.943521 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.944314 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.950350 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.977088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:51.977530 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:51.977975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'fault' on Instance uuid 43a1e290-4870-4dff-a043-14915d563e75 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:52.022377 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:52.029726 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-73630aaa-63b3-4745-877f-4ee577df112a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 200 len: 1311 microversion: 2.1 time: 0.099198 Jun 06 20:46:52.030279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 262/533] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:51 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:52.575898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:52.576439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:52.583519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:52.584638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:52.585601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:52.586045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:52.719769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:52.727197 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c0400e84-494d-46ad-ad9f-16aff186e5b7 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1549 microversion: 2.1 time: 0.155180 Jun 06 20:46:52.727805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 272/534] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:52 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:52.743057 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:52.743551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:52.749635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:52.750131 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:52.750895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:52.751327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:52.832646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b84a87cd-29a3-4d12-b852-10fe6e7c1c12 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093320 Jun 06 20:46:52.833471 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 263/535] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:46:52 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:53.046459 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:53.047064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: 43a1e290-4870-4dff-a043-14915d563e75] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:53.053441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.053887 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.054646 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.055081 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.068791 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] HTTP exception thrown: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Request method failure captured: Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 HTTP/1.1 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmauKKDC_pjMkLbjlQHnS_V0pO7S5z25CA25lTZCfKtnWZzDQ0PmQ1smF7PeF_kSgeBsGJtrS3clGfPhg5jpf_oFa9gJ-qILgOHN9u8sPawE023JzgJ3OZcl81kIfaX2ctg5buPM1qDtujGhvQYDvT3hPjnecxmf5L7wL_-8t7g3zRo Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:46:53.070407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffb14a29d13a483ba8733e0bb3a56a17", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a10ffb60631240fdb6b4a69d6d7f73e2 Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. Jun 06 20:46:53.071949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '43a1e290-4870-4dff-a043-14915d563e75'} Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:46:53.072753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. Jun 06 20:46:53.074170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:46:53.075268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Returning 404 to user: Instance 43a1e290-4870-4dff-a043-14915d563e75 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:46:53.075268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-bf9b9250-85fc-4489-b08b-7adcb29ad0c3 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75" status: 404 len: 111 microversion: 2.1 time: 0.029411 Jun 06 20:46:53.075268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 273/536] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:53 2022] GET /compute/v2.1/servers/43a1e290-4870-4dff-a043-14915d563e75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:46:53.087010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:53.087010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:53.088005 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.088458 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.089230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.089663 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.092412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:46:53.115511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:46:53.450081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0c26a7e5-9918-4c15-a021-6c51d5103422 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 204 len: 0 microversion: 2.1 time: 0.372484 Jun 06 20:46:53.450859 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 264/537] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:46:53 2022] DELETE /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:46:53.458757 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:53.459642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:53.466404 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.466863 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.467638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.468114 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.600749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:53.608117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1b999080-a5eb-42a2-9727-b7a50da79c44 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.153171 Jun 06 20:46:53.608689 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 274/538] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:53 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:53.799711 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-cd1676e2-5a0b-4e6e-ac67-1147a0f3bd60 req-dc1b5e99-25e4-4977-9d74-b71e8b1b519c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a253f5a-4a96-4b83-b854-a41081156f1f", "tag": "023f96ea-b1c9-42a8-b7df-1571b32ec938"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:53.807715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-cd1676e2-5a0b-4e6e-ac67-1147a0f3bd60 req-dc1b5e99-25e4-4977-9d74-b71e8b1b519c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:53.808159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-cd1676e2-5a0b-4e6e-ac67-1147a0f3bd60 req-dc1b5e99-25e4-4977-9d74-b71e8b1b519c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:53.819356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-cd1676e2-5a0b-4e6e-ac67-1147a0f3bd60 req-dc1b5e99-25e4-4977-9d74-b71e8b1b519c service nova] Creating event network-changed:023f96ea-b1c9-42a8-b7df-1571b32ec938 for instance 4a253f5a-4a96-4b83-b854-a41081156f1f on hv-cinder-84487 Jun 06 20:46:53.824100 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-cd1676e2-5a0b-4e6e-ac67-1147a0f3bd60 req-dc1b5e99-25e4-4977-9d74-b71e8b1b519c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028461 Jun 06 20:46:53.824702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 265/539] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:54.625862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:54.626511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:54.634205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:54.634653 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:54.635433 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:54.635901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:54.774336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:54.774336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f0781097-d356-4866-a351-6291f4b05b3a tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.150259 Jun 06 20:46:54.774336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 275/540] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:54 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:55.790130 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:55.790822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:55.797320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:55.797761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:55.798509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:55.798939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:55.929701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:55.933192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5c8c6c0d-ee4d-488b-8623-5fe1adfb4762 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.147666 Jun 06 20:46:55.933748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 266/541] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:55 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:56.950680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:56.956560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:56.958335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:56.958859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:56.959725 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:56.960225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:57.167591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:57.175762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-33f4e018-56b7-490b-b3af-8cff211fce5e tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1520 microversion: 2.1 time: 0.229165 Jun 06 20:46:57.185122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 276/542] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:56 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:57.394059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-f1fbe53e-ba2c-48de-835c-ac14cdacebaa req-badbbbdb-c83a-4e08-93b0-99c4e8d27f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8acd09-79a4-423a-9e5b-91aff7b7fce8", "name": "network-vif-deleted", "tag": "013be499-39fe-4107-8a50-02caa10510df"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:46:57.402572 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f1fbe53e-ba2c-48de-835c-ac14cdacebaa req-badbbbdb-c83a-4e08-93b0-99c4e8d27f61 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:57.403016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f1fbe53e-ba2c-48de-835c-ac14cdacebaa req-badbbbdb-c83a-4e08-93b0-99c4e8d27f61 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:57.414467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-f1fbe53e-ba2c-48de-835c-ac14cdacebaa req-badbbbdb-c83a-4e08-93b0-99c4e8d27f61 service nova] Creating event network-vif-deleted:013be499-39fe-4107-8a50-02caa10510df for instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 on hv-cinder-84487 Jun 06 20:46:57.419332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-f1fbe53e-ba2c-48de-835c-ac14cdacebaa req-badbbbdb-c83a-4e08-93b0-99c4e8d27f61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029473 Jun 06 20:46:57.420047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 267/543] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:46:58.192618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:58.193248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:58.199683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:58.200135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:58.200884 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:58.201381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:58.234963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:58.235524 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:58.235991 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lazy-loading 'fault' on Instance uuid ab8acd09-79a4-423a-9e5b-91aff7b7fce8 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:46:58.287130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ffb60631240fdb6b4a69d6d7f73e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb14a29d13a483ba8733e0bb3a56a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:46:58.294935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5c182cd3-1e7d-4e73-867b-dd319f3a8eed tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 200 len: 1311 microversion: 2.1 time: 0.106698 Jun 06 20:46:58.295498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 277/544] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:58 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:46:59.312740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:46:59.313442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] [instance: ab8acd09-79a4-423a-9e5b-91aff7b7fce8] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:46:59.320138 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:59.320589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:59.321354 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:46:59.321791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:46:59.335422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] HTTP exception thrown: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Request method failure captured: Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 HTTP/1.1 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmauKKDC_pjMkLbjlQHnS_V0pO7S5z25CA25lTZCfKtnWZzDQ0PmQ1smF7PeF_kSgeBsGJtrS3clGfPhg5jpf_oFa9gJ-qILgOHN9u8sPawE023JzgJ3OZcl81kIfaX2ctg5buPM1qDtujGhvQYDvT3hPjnecxmf5L7wL_-8t7g3zRo Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:46:59.337021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffb14a29d13a483ba8733e0bb3a56a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffb14a29d13a483ba8733e0bb3a56a17", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: ffb14a29d13a483ba8733e0bb3a56a17 Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-754261160 Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: a10ffb60631240fdb6b4a69d6d7f73e2 Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-ServerRescueNegativeTestJSON-754261160-project Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. Jun 06 20:46:59.338325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': 'ab8acd09-79a4-423a-9e5b-91aff7b7fce8'} Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:46:59.339152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. Jun 06 20:46:59.340638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:46:59.341939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] Returning 404 to user: Instance ab8acd09-79a4-423a-9e5b-91aff7b7fce8 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:46:59.341939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b7f60626-a3e6-4621-901c-4fad5075f550 tempest-ServerRescueNegativeTestJSON-754261160 tempest-ServerRescueNegativeTestJSON-754261160-project] 10.222.0.41 "GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8" status: 404 len: 111 microversion: 2.1 time: 0.030442 Jun 06 20:46:59.341939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 268/545] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:46:59 2022] GET /compute/v2.1/servers/ab8acd09-79a4-423a-9e5b-91aff7b7fce8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:47:05.324553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:05.325417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:05.332839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:05.333364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:05.334113 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:05.334539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:05.374271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=100 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:05.544258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-357d59f7-fe5f-4ba5-8531-51c2cacb21c6 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action" status: 202 len: 0 microversion: 2.1 time: 0.223532 Jun 06 20:47:05.545297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 278/546] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:47:05 2022] POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:47:05.552970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:05.553582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:05.560827 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:05.561004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:05.561655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:05.562087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:05.705638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:05.713929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-24dc0a38-1977-4e7a-877e-928eee324e6b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1751 microversion: 2.1 time: 0.164898 Jun 06 20:47:05.714483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 269/547] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:05 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:06.168265 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-acd9f54a-50a7-40a9-b75b-2cdc903dda7d tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea24b3a0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:06.326594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-acd9f54a-50a7-40a9-b75b-2cdc903dda7d tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/6b986b9a-fe19-4c4c-ad0c-45e1e4d67e87" status: 200 len: 351 microversion: 2.1 time: 0.164572 Jun 06 20:47:06.327203 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 279/548] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:47:06 2022] GET /compute/v2.1/os-volumes/6b986b9a-fe19-4c4c-ad0c-45e1e4d67e87 => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:06.731474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:06.732250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:06.738711 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:06.739600 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:06.740036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:06.740467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:06.992859 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:07.000051 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c85a740c-51cb-4c6b-9b54-6cedface1fa9 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.272334 Jun 06 20:47:07.000605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 270/549] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:06 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:07.914616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b7f7c1cb-142a-4447-a07a-b100eebe4a26 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea216af0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:07.960713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b7f7c1cb-142a-4447-a07a-b100eebe4a26 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b1e32d09-b194-48f9-9c6f-cdb1eb16382c" status: 200 len: 350 microversion: 2.1 time: 0.050409 Jun 06 20:47:07.961306 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 280/550] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:47:07 2022] GET /compute/v2.1/os-volumes/b1e32d09-b194-48f9-9c6f-cdb1eb16382c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:08.017555 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:08.018180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:08.024553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:08.025007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:08.025771 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:08.026207 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:08.163688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:08.172042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5a2a405d-5a87-4c03-b7cf-a65668a32147 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.158419 Jun 06 20:47:08.172610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 271/551] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:08 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:09.190470 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.191197 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:09.198412 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:09.198864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:09.199748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:09.200146 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:09.353802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:09.361772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-01cd0284-4e27-456f-be4b-bd61fbe4eb68 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.175715 Jun 06 20:47:09.363696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 281/552] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:09.568174 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-75dcd8ef-f836-482d-8ed7-fd2525f95870 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea10fdc0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.614503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-75dcd8ef-f836-482d-8ed7-fd2525f95870 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/00e9b6e5-ec6a-4e1d-8e79-76d03600ce2c" status: 200 len: 349 microversion: 2.1 time: 0.050097 Jun 06 20:47:09.615053 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 272/553] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes/00e9b6e5-ec6a-4e1d-8e79-76d03600ce2c => generated 349 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:09.626077 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aa7462de-33c1-482f-b2a1-5087ba1230f8 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea382af0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.704922 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aa7462de-33c1-482f-b2a1-5087ba1230f8 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.082494 Jun 06 20:47:09.705485 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 282/554] 10.222.0.41 () {58 vars in 1133 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:47:09.718194 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2a5ca5c8-4390-4205-babf-3e9941ec34bf tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea291dc0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.798513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2a5ca5c8-4390-4205-babf-3e9941ec34bf tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083995 Jun 06 20:47:09.799079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 273/555] 10.222.0.41 () {58 vars in 1148 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:09.810627 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1e5d8c20-5620-4fdb-95ed-c1ec0363e3e4 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea32e670>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.889815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1e5d8c20-5620-4fdb-95ed-c1ec0363e3e4 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.082841 Jun 06 20:47:09.890619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 283/556] 10.222.0.41 () {58 vars in 1133 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:09.902238 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3402ab3a-3dc5-42ab-b7a7-eb21970b0d0e tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea0cc160>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:09.980497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3402ab3a-3dc5-42ab-b7a7-eb21970b0d0e tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081946 Jun 06 20:47:09.981058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 274/557] 10.222.0.41 () {58 vars in 1166 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:09.992432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e0417121-73d6-4a14-bedf-5515150647d3 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea216820>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:10.072101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e0417121-73d6-4a14-bedf-5515150647d3 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083246 Jun 06 20:47:10.072665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 284/558] 10.222.0.41 () {58 vars in 1169 bytes} [Mon Jun 6 20:47:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:10.084797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8b45651d-c85c-4dc4-8f17-26d7c0c2fee4 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea0e7280>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:10.165416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8b45651d-c85c-4dc4-8f17-26d7c0c2fee4 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084819 Jun 06 20:47:10.165990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 275/559] 10.222.0.41 () {58 vars in 1154 bytes} [Mon Jun 6 20:47:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:10.177867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1b325470-f83f-4d71-8b6b-468761527aa2 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea216e50>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:10.257308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1b325470-f83f-4d71-8b6b-468761527aa2 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083941 Jun 06 20:47:10.257923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 285/560] 10.222.0.41 () {58 vars in 1187 bytes} [Mon Jun 6 20:47:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:10.269574 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4ec4c31f-5f5d-4aa9-bf4c-dec29e5f84d8 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] Calling method '.version_select at 0x7fdaea149af0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:10.347118 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4ec4c31f-5f5d-4aa9-bf4c-dec29e5f84d8 tempest-VolumesTestJSON-2084865829 tempest-VolumesTestJSON-2084865829-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.081239 Jun 06 20:47:10.347715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 276/561] 10.222.0.41 () {58 vars in 1154 bytes} [Mon Jun 6 20:47:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:10.379804 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:10.380410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:10.387092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:10.387549 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:10.388373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:10.388809 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:10.527003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:10.535476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-66cb699c-d082-4613-b829-22aedfd7c29b tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.160033 Jun 06 20:47:10.536080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 286/562] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:10 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:11.553418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:11.554121 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:11.556502 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:11.561232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:11.565748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:11.565748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:11.565748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:11.707394 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:11.715338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f921f65d-4e92-44cb-8623-111e86077508 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.166254 Jun 06 20:47:11.715928 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 277/563] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:11 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:12.732520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:12.733132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:12.735523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:12.740340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:12.740787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:12.741559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:12.741993 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:13.153178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:13.161148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-73210938-c3a2-4a45-9c59-018283a6ca5a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.432457 Jun 06 20:47:13.161716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 287/564] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:12 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:47:14.178451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:14.179746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:14.186388 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:14.186997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:14.187788 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:14.188243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:14.332851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:14.341430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f38d986d-9bd5-4428-90c2-458f103a0f44 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.166945 Jun 06 20:47:14.341997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 278/565] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:14 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:15.358251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:15.359882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:15.366687 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:15.367168 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:15.367952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:15.368383 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:15.511523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:15.519717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e3802e16-10f8-412c-8f50-5a9e55328179 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.165327 Jun 06 20:47:15.520271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 288/566] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:15 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:16.013084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:16.013603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:16.020347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:16.020801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:16.021566 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:16.022050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:16.044658 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-76148144-ecab-4e2f-88db-feadf811f81d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/ips" status: 200 len: 151 microversion: 2.20 time: 0.035414 Jun 06 20:47:16.045240 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 279/567] 10.222.0.41 () {60 vars in 1288 bytes} [Mon Jun 6 20:47:16 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:47:16.536710 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:16.537300 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:16.544359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:16.544800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:16.545552 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:16.545980 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:16.704000 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:16.713732 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c6250d88-b924-4675-a0d7-e076e971e182 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.180869 Jun 06 20:47:16.723444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 289/568] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:16 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:47:17.730315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:17.730989 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:17.737039 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:17.737489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:17.738284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:17.738719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:17.889008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:17.897703 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-936a1cc7-a6db-4a5c-b129-211ed7c0f1b7 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.171201 Jun 06 20:47:17.899169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 280/569] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:17 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:18.281823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:18.282928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:18.289918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.290393 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:18.291153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.291581 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:18.314044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lazy-loading 'flavor' on Instance uuid 94d1b9fd-5baf-46e9-88f6-a367244145bb {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:47:18.917695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:18.918250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:18.924509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6c5ae7ed-8eba-480e-a6df-51b9a86e430f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/action" status: 202 len: 0 microversion: 2.20 time: 0.646412 Jun 06 20:47:18.925894 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 290/570] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 20:47:18 2022] POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:47:18.926047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.926047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:18.926489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.926957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:18.933605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:18.938857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:18.940886 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.941337 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:18.942107 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:18.942544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:19.097422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:19.099816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:19.106384 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-dcccfceb-1f5f-4514-a630-febe9007ae4d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.192592 Jun 06 20:47:19.108154 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:19.109629 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:19.110794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-211565e5-e2cc-4d10-a02b-9cffb6ac4115 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.181271 Jun 06 20:47:19.111338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 291/571] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:18 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:19.116548 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 281/572] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:18 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:20.124187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:20.125167 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:20.129809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:20.130527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:20.131975 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:20.132426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:20.133407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:20.134035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:20.138166 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:20.138805 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:20.139805 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:20.140500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:20.281536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:20.289672 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-91ee908b-10b0-40cb-ac5e-277cd887c434 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.169580 Jun 06 20:47:20.290240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 292/573] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:20 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:20.308909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:20.314497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:20.316048 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:20.317192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-067ec98d-bfb3-49d3-b9eb-ad3714f3821a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.191356 Jun 06 20:47:20.317742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 282/574] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:20 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:21.307230 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:21.307873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:21.315051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:21.315508 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:21.316324 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:21.316764 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:21.337538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:21.338152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:21.344742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:21.345262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:21.346106 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:21.346609 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:21.470150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:21.478128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d3681c7a-6074-45b5-8a77-4a536d2a9655 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.175351 Jun 06 20:47:21.478694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 293/575] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:21 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:21.484308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:21.493676 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:21.495475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:21.497407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6dba2664-1917-43a1-833b-bdb1965b8f35 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.164702 Jun 06 20:47:21.497514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 283/576] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:21 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:22.495042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:22.495964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:22.502343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:22.502987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:22.503928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:22.504524 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:22.665471 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:22.673369 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b074423b-76e7-4ca3-a011-134fed8f322d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1756 microversion: 2.1 time: 0.182808 Jun 06 20:47:22.673941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 294/577] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:22 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:22.696174 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:22.699656 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:22.710184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:22.710184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:22.710184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:22.710184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:22.839499 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:22.847788 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:22.849288 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:22.850449 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3087f168-18a0-4c79-9326-8511badc798f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.338725 Jun 06 20:47:22.851000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 284/578] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:22 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:23.690962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:23.691650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:23.698099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:23.698545 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:23.699436 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:23.699902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:23.842536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:23.850684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b9d91ba0-09a6-4b98-a248-0679d5c9d335 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1759 microversion: 2.1 time: 0.163810 Jun 06 20:47:23.851256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 295/579] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:23 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:23.869586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:23.870193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:23.876715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:23.877168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:23.877933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:23.878372 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:23.882893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:24.008849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:24.016959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:24.018454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:24.019614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-27663f44-0fca-41ad-8144-bbc5a2e04616 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.154378 Jun 06 20:47:24.020200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 285/580] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:23 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:25.038049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:25.038652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:25.045041 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:25.045514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:25.046273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:25.046705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:25.176642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:25.184591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:25.186169 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:25.187410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d03b50da-1409-490e-8c68-d36db5682c59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.153713 Jun 06 20:47:25.187994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 296/581] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:25 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:26.205464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:26.206076 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:26.213368 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:26.217881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:26.217881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:26.217881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:26.347507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:26.355894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:26.357374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:26.358504 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9c137f21-2441-4b29-ac5c-f726bb9ed15d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.156956 Jun 06 20:47:26.359055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 286/582] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:26 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:27.379889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:27.379889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:27.384843 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:27.385293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:27.386043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:27.386480 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:27.519304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:27.527331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:27.528760 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:27.529895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9f0ab8c3-22db-4de6-bafe-ed06b4f6ff3a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.157220 Jun 06 20:47:27.530458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 297/583] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:27 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:28.547931 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:28.548479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:28.554906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:28.555357 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:28.557727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:28.557727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:28.692611 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:28.701501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:28.703067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:28.704229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-51890fb9-3c92-4674-9e73-cc7a825678de tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.160282 Jun 06 20:47:28.704781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 287/584] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:28 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:29.722424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:29.723066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:29.730464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:29.730923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:29.731741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:29.732298 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:29.860921 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:29.863204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:29.869715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:29.871297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:29.872491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-56f77112-24db-446d-abd1-d11aa77864d2 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.154001 Jun 06 20:47:29.873035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 298/585] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:29 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:29.984613 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:29.989079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:29.991220 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:29.991688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:29.992453 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:29.992963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:30.016099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-37c55ab2-508f-41ab-989a-66d8b3c70680 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/ips" status: 200 len: 147 microversion: 2.1 time: 0.194333 Jun 06 20:47:30.017930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 288/586] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:47:29 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/ips => generated 147 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:47:30.890940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:30.891544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:30.899256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:30.899717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:30.900467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:30.900893 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:31.032660 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:31.040443 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:31.041924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:31.043056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1bf60d4b-b99d-460a-a0df-5fc37b2cea8a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.156196 Jun 06 20:47:31.043597 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 299/587] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:30 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:31.563977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4bf70f8-2bc7-498e-9617-6894efcf8ac7"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:31.565084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:31.571538 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:31.572007 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:31.572832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:31.573260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:32.060427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:32.061027 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:32.067514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:32.067987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:32.077862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:32.077862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:32.200532 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:32.208613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:32.210095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:32.211239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d837e02e-c70e-4d3a-abab-73439a157f5a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.155039 Jun 06 20:47:32.211937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 300/588] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:32 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:32.277430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2f660574-200c-4197-bdea-2df34559a5ac tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717169 Jun 06 20:47:32.278044 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 289/589] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:47:31 2022] POST /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:33.229896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:33.230943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:33.237104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:33.237547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:33.238318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:33.238751 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:33.372929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:33.382381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:33.383938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:33.385075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5ca913ae-d2c8-4051-a371-f89555bdec6b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.159123 Jun 06 20:47:33.385615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 301/590] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:33 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:34.404519 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:34.405251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:34.411876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:34.412323 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:34.413089 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:34.413516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:34.543367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:34.552823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:34.555083 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:34.556300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3f5ab25c-b7ba-4863-bab7-455af86e709c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.156822 Jun 06 20:47:34.557092 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 290/591] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:34 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:35.574312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:35.574937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:35.581380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:35.581819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:35.582571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:35.582996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:35.716802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:35.723858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:35.725911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:35.727133 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a9a4a8d1-f7b2-44b2-833c-5e108e2dc4db tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1744 microversion: 2.20 time: 0.156717 Jun 06 20:47:35.728148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 302/592] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:35 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:36.746551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:36.747156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:36.753715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:36.754159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:36.754906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:36.755360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:36.887902 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:36.896001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:36.897579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:36.898602 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4eea7b56-76eb-463d-abc5-ab9309cd5157 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.156621 Jun 06 20:47:36.899155 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 291/593] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:36 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:37.734828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-b45669dc-5a75-46df-ba1e-b639bbdab560 req-7d30722d-2e25-407a-926d-7756208822f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "name": "network-vif-plugged", "status": "completed", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:37.747555 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b45669dc-5a75-46df-ba1e-b639bbdab560 req-7d30722d-2e25-407a-926d-7756208822f1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:37.748249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b45669dc-5a75-46df-ba1e-b639bbdab560 req-7d30722d-2e25-407a-926d-7756208822f1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:37.762574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-b45669dc-5a75-46df-ba1e-b639bbdab560 req-7d30722d-2e25-407a-926d-7756208822f1 service nova] Creating event network-vif-plugged:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:47:37.768438 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-b45669dc-5a75-46df-ba1e-b639bbdab560 req-7d30722d-2e25-407a-926d-7756208822f1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040234 Jun 06 20:47:37.771870 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 303/594] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:37.917356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:37.917971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:37.927693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:37.928242 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:37.929016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:37.930107 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:38.096524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:38.108430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:38.110350 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:38.111702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fc5df2de-52bf-4ebb-8158-d6964f8cdc2d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.198660 Jun 06 20:47:38.124160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 292/595] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:37 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:39.131795 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:39.133835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:39.141719 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.142464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.143486 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.147589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.307082 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:39.315135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:39.318376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:39.318376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-71c3148d-2352-4b2c-8518-ccf518cfc864 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.190937 Jun 06 20:47:39.318795 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 304/596] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:39 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:39.794211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:39.795200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:39.801592 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.835650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.835650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.835650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.835650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-aa3ff9e3-f9a7-44fb-ac5a-d218b43520a0 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Jun 06 20:47:39.836482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 293/597] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:47:39 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:39.844178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:39.844668 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:39.850620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.851064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.852351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:39.852782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:39.881132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b45170b9-0755-413c-8c7c-b9fff4905278 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7" status: 200 len: 194 microversion: 2.1 time: 0.040838 Jun 06 20:47:39.881697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 305/598] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 20:47:39 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:40.337851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:40.338486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:40.346973 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:40.347426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:40.348455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:40.348894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:40.568801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:40.581589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:40.583335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:40.584652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-aabc0d2c-7ec5-4ed7-ac65-81b2123d5654 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.251766 Jun 06 20:47:40.586455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 294/599] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:40 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:41.566203 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ca4cd75-64b0-44ec-b385-aa9ddc21d69b"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:41.567459 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:41.575308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:41.576062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:41.576924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:41.577427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:41.604137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:41.605385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:41.614074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:41.614705 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:41.615816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:41.617311 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:41.777214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:41.795867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:41.797381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:41.801479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b19ba91f-82c3-4809-96ec-74f69004a93b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.202082 Jun 06 20:47:41.813351 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 295/600] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:41 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:42.342152 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f8f58041-1977-4a60-b9e2-9c51f8eb4cec tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "POST /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782524 Jun 06 20:47:42.343554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 306/601] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:47:41 2022] POST /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:42.821421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:42.822984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:42.826999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=38 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:42.831067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:42.843838 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:42.843838 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:42.843838 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:42.988418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:42.998251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:43.001616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:43.001616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-818e5fd3-9ef7-4549-9620-b7aea88abdab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.184457 Jun 06 20:47:43.012688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 296/602] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:42 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:44.021973 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:44.022589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:44.035717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=40 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:44.038051 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:44.038509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:44.039434 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:44.039904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:44.219388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:44.224141 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:44.227822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:44.229184 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9e5d9689-ebfd-4e8d-b7ac-f2bb8d3cedca tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.212604 Jun 06 20:47:44.229894 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 307/603] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:44 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:45.247328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:45.248826 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:45.256314 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.257034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:45.257831 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.258466 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:45.441130 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:45.449955 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:45.452270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:45.453654 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-063104a9-94fd-454b-bc02-063530959ba3 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.210669 Jun 06 20:47:45.465307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 297/604] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:45 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:45.536210 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:45.537835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:45.551187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.552130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:45.553142 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.553780 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:45.588127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lazy-loading 'flavor' on Instance uuid a684536b-660f-47af-b824-2970df61db1d {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:47:45.887397 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0cdfab03-b8a5-4037-b8a4-bcf6785201fc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "POST /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d/action" status: 202 len: 0 microversion: 2.1 time: 0.355848 Jun 06 20:47:45.888034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 308/605] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:47:45 2022] POST /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:47:45.896990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:45.898623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:45.907278 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.907759 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:45.908544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:45.908988 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:46.065319 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:46.074527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4b8ddc46-8378-46f9-a789-87358a742eb1 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.181378 Jun 06 20:47:46.075473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 298/606] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:45 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:46.473697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:46.474439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:46.484771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:46.485227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:46.486055 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:46.486490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:46.629061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:46.638258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:46.640406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:46.641559 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dd1ccfa7-9acf-44f9-934d-39a18e4831d1 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.172399 Jun 06 20:47:46.642150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 309/607] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:46 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:47.092970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:47.093738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:47.100517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:47.100964 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:47.102307 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:47.102740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:47.278084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:47.288655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-600e5eb4-3014-4c11-97cb-1426f38fc661 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.199566 Jun 06 20:47:47.290259 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 299/608] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:47 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:47.670964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:47.670964 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:47.689962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:47.690509 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:47.691497 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:47.692079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:47.846971 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:47.856023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:47.857622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:47.858815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-40509815-73d4-4f96-aaaf-76c539aff383 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1739 microversion: 2.20 time: 0.199347 Jun 06 20:47:47.859380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 310/609] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:47 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:48.306311 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:48.306924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:48.313353 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:48.313805 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:48.314566 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:48.315008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:48.449494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:48.451686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:48.457490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cbd5b8fe-76d6-45ca-ba4b-c97e9bba89dd tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.155540 Jun 06 20:47:48.462997 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 300/610] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:48 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:48.876896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:48.877500 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:48.883955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:48.884403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:48.885157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:48.885589 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:49.010490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:49.018435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:49.019969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:49.021095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b0569c40-7265-4e1f-810e-840a9bd940d9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.148029 Jun 06 20:47:49.021647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 311/611] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:48 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:49.475752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:49.476424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:49.483843 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:49.484299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:49.485097 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:49.485537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:49.621573 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:49.629290 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8a70d41a-58a3-4180-8b1c-7cebc2a24f4e tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.158746 Jun 06 20:47:49.629859 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 301/612] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:49 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:50.039077 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:50.041090 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:50.047493 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:50.047985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:50.048797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:50.049237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:50.232145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:50.234483 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:47:50.241143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:50.243226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:50.244410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-10bec823-3040-4e85-bafc-e13c19ba80f0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.209242 Jun 06 20:47:50.244942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 312/613] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:50 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:50.649559 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:50.650143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:50.656196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:50.656644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:50.657434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:50.657873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:50.790744 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:50.798752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0d857555-8e67-445a-96f0-37275e45e736 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.154873 Jun 06 20:47:50.799422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 302/614] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:50 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:51.263937 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:51.264961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:51.273125 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:51.273682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:51.274624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:51.275116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:51.411864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:51.421628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:51.423112 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:51.424285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-12e63100-f515-4111-9926-6508c40d19f4 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.165558 Jun 06 20:47:51.429894 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 313/615] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:51 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:51.817659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:51.818287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:51.825126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:51.828851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:51.828851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:51.828851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:51.986537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:51.994345 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-19bc97b5-420c-4731-84ce-2799b1298509 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.181260 Jun 06 20:47:51.994906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 303/616] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:51 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:52.023899 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-b79c490f-f35c-4946-8ae7-44052ad53536 req-d28d9a0f-2113-4ea4-952a-a070fd5c182f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "name": "network-vif-unplugged", "status": "completed", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:52.032036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b79c490f-f35c-4946-8ae7-44052ad53536 req-d28d9a0f-2113-4ea4-952a-a070fd5c182f service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:52.032475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b79c490f-f35c-4946-8ae7-44052ad53536 req-d28d9a0f-2113-4ea4-952a-a070fd5c182f service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:52.043432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-b79c490f-f35c-4946-8ae7-44052ad53536 req-d28d9a0f-2113-4ea4-952a-a070fd5c182f service nova] Creating event network-vif-unplugged:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:47:52.048435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-b79c490f-f35c-4946-8ae7-44052ad53536 req-d28d9a0f-2113-4ea4-952a-a070fd5c182f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157858 Jun 06 20:47:52.049036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 314/617] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:47:52.441346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:52.441946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:52.447927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:52.448368 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:52.449119 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:52.449570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:52.577106 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:52.584998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:52.586473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:52.587609 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8cd5223b-2251-4312-8e05-7a3a4e94fb4d tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.150146 Jun 06 20:47:52.588188 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 304/618] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:52 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:53.014172 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:53.015165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:53.021591 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.022038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.022839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.023386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.074155 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:53.075145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:53.081674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.082125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.082894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.083332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.114394 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-78ecd1c5-e78f-4745-a04f-39d7b6838861 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044089 Jun 06 20:47:53.114970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 305/619] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:47:53 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:47:53.159564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:53.166497 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-889b3b02-d788-4945-aea5-45dc1cff7bc4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.157001 Jun 06 20:47:53.167059 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 315/620] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:53 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:53.258498 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:53.259002 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:53.265345 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.265828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.266595 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.267028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.296280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4d07e4f6-33d0-43ca-88d1-454c407bec42 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7" status: 200 len: 194 microversion: 2.1 time: 0.042257 Jun 06 20:47:53.296862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 306/621] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 20:47:53 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:53.306828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:53.307317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:53.313340 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.313781 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.314524 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.314947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.396886 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'services' on Instance uuid 4a253f5a-4a96-4b83-b854-a41081156f1f {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:47:53.605535 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:53.606145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:53.612303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.612763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.613516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:53.613953 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:53.660013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-09d0c94a-ef48-45a0-83f4-e3aca62cc55d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7" status: 202 len: 0 microversion: 2.1 time: 0.356893 Jun 06 20:47:53.660610 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 316/622] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:47:53 2022] DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/d4bf70f8-2bc7-498e-9617-6894efcf8ac7 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:47:53.748896 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:53.756909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:53.759024 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:53.760250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d32f917b-f9bd-4099-a75b-4ae58440fdfc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.158628 Jun 06 20:47:53.760800 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 307/623] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:53 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:47:54.185587 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:54.186199 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:54.192342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:54.192787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:54.193544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:54.193975 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:54.332824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:54.340560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-60fd3e98-f0f3-41a9-8d59-293a9f040ae4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.160510 Jun 06 20:47:54.341143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 317/624] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:54 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:54.780015 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:54.780614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:54.787039 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:54.787474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:54.788260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:54.788891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:54.912791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:54.921202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:54.922675 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:54.923870 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-54fb15f5-1e09-4660-96ef-88efefa41209 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.147662 Jun 06 20:47:54.924426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 308/625] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:54 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:55.359417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:55.360050 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:55.366506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:55.366952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:55.367733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:55.368169 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:55.496574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:55.504046 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-52489004-9684-4034-be02-797a71a957dc tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.148445 Jun 06 20:47:55.504605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 318/626] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:55 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:55.942282 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:55.942873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:55.950013 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:55.950462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:55.951211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:55.951641 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:56.078417 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:56.086333 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:56.087854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:56.088998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-42ad2311-1908-49a7-87c7-0c8ccfcb9b59 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.150621 Jun 06 20:47:56.089548 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 309/627] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:55 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:56.521635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:56.522248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:56.529346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:56.529788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:56.530539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:56.530968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:56.660328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:56.668549 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-da3b608d-a115-48a5-a739-17fdb4f9d3c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.150867 Jun 06 20:47:56.669107 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 319/628] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:56 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:57.107233 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:57.107862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:57.114390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:57.114787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:57.115534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:57.115991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:57.241568 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:57.250193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:57.251715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:57.252861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c1d5584c-deaf-471e-a460-52c64216628a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1721 microversion: 2.20 time: 0.149471 Jun 06 20:47:57.253411 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 310/629] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:57 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:57.685767 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:57.686392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:57.693129 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:57.693579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:57.694356 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:57.694806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:57.828828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:57.837021 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1642c8c6-0429-46a3-b001-82b8f8dfd832 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.154590 Jun 06 20:47:57.837514 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 320/630] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:57 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:47:58.270839 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:58.272105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:58.288924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.289371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.290169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.290599 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.439986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:58.448346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:58.449940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:58.451465 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7b29dc3d-2cbd-4210-8a48-1faae1474e74 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1724 microversion: 2.20 time: 0.184710 Jun 06 20:47:58.465356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 311/631] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:47:58 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:47:58.470001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "161707b6-f0e8-4222-a405-4c1d13110c60"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:47:58.471060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:58.480723 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.481180 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.483354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.483856 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.854697 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:58.855287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:58.861280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.861727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.862479 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:58.862907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:58.999891 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:47:59.007355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2f4056d8-5aa9-4eac-97da-8b379cc084e6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.157023 Jun 06 20:47:59.008002 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 312/632] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:47:58 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:47:59.012969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:59.013489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:59.019323 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.019801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.020559 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.020991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.049191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8b813f0c-2f00-4cf9-8c32-a9fe5b2ee758 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/2ca4cd75-64b0-44ec-b385-aa9ddc21d69b" status: 200 len: 194 microversion: 2.1 time: 0.039678 Jun 06 20:47:59.049775 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 313/633] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 20:47:59 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/2ca4cd75-64b0-44ec-b385-aa9ddc21d69b => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:47:59.059616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:59.060135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:59.065751 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.066199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.066954 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.067388 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.146383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'services' on Instance uuid 4a253f5a-4a96-4b83-b854-a41081156f1f {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:47:59.356462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-03e6ffb3-cb29-42b3-b4af-c01a1d28150d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/2ca4cd75-64b0-44ec-b385-aa9ddc21d69b" status: 202 len: 0 microversion: 2.1 time: 0.300102 Jun 06 20:47:59.357162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 314/634] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:47:59 2022] DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments/2ca4cd75-64b0-44ec-b385-aa9ddc21d69b => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:47:59.533910 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a3f41c4e-030d-4bc6-b744-b5a75720422c tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.068604 Jun 06 20:47:59.534444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 321/635] 10.222.0.41 () {62 vars in 1363 bytes} [Mon Jun 6 20:47:58 2022] POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments => generated 188 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:47:59.652557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:47:59.653160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:47:59.659617 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.660104 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.660854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:47:59.661277 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:47:59.869868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:00.026267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:00.026874 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:00.034053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:00.034493 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:00.035244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:00.035694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:00.162145 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:00.169510 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-290fd320-4bc4-4ca9-ae13-3225020d709f tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.147759 Jun 06 20:48:00.170062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 322/636] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:00 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:01.116406 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1c25e837-a657-4a10-9cf9-d3331b134594 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments/161707b6-f0e8-4222-a405-4c1d13110c60" status: 202 len: 0 microversion: 2.20 time: 1.468614 Jun 06 20:48:01.117066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 315/637] 10.222.0.41 () {60 vars in 1456 bytes} [Mon Jun 6 20:47:59 2022] DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments/161707b6-f0e8-4222-a405-4c1d13110c60 => generated 0 bytes in 1470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:48:01.172006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:01.172571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:01.178896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.180395 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.180395 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.180621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.186242 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:01.187017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:01.193116 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.193558 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.194315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.194742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.325862 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:01.333412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5dd758cd-154c-4f25-bbe5-f3dc046029f7 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.151062 Jun 06 20:48:01.341881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 316/638] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:01 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:01.415175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1862a550-0058-4342-b1da-f81eef58a649 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/action" status: 202 len: 0 microversion: 2.20 time: 0.246929 Jun 06 20:48:01.415733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 323/639] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 20:48:01 2022] POST /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:48:01.424313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:01.427371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:01.431267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.431738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.432496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:01.432926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:01.568459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:01.577010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:01.578507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:01.581601 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-98e4af5b-b353-4066-88d6-81b7c414c56f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1672 microversion: 2.20 time: 0.159863 Jun 06 20:48:01.581601 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 317/640] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:01 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:02.351523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:02.352674 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:02.359393 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:02.359915 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:02.360630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:02.361058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:02.510410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:02.518330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a8005d31-10ff-4f5d-b72b-416f1432120d tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.171257 Jun 06 20:48:02.518930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 324/641] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:02 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:02.598413 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:02.599083 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:02.606710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:02.607191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:02.608132 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:02.608561 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:02.937549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:02.946171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:02.947704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:02.948863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f534370c-7dbd-4de2-874e-d0ca48ad7647 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1672 microversion: 2.20 time: 0.354487 Jun 06 20:48:02.949422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 318/642] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:02 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1672 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:03.537675 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:03.538289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.545750 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.546271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.547226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.548104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.698323 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:03.700643 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:03.701849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:03.703352 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.708936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e726e424-873b-4aca-aa88-da0fc5053715 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1569 microversion: 2.1 time: 0.174991 Jun 06 20:48:03.710716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 325/643] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:03 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:03.710825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.710825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.711730 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.712370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.726670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:03.727234 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.733762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.734202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.735231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.735889 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.743623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8df21081-c692-4d9a-8f80-cbdd517c8703 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045532 Jun 06 20:48:03.744224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 319/644] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:03 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:48:03.857822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:03.863484 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.866631 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.867219 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.868165 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.868672 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.901949 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8c88b53d-6c3a-46b2-bd40-b844014283fb tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048489 Jun 06 20:48:03.902315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 320/645] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:03 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:48:03.958006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aeb4718d-03dd-4c14-a67a-49a4698c5ee4 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "POST /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d/action" status: 202 len: 0 microversion: 2.1 time: 0.235017 Jun 06 20:48:03.958982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 326/646] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:48:03 2022] POST /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:48:03.966361 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:03.966943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.973631 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.974085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.974906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.975249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:03.975382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.976328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:03.989750 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.992468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:03.992468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:03.992468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:04.005861 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:48:04.144163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:04.152878 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:04.154290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:04.155460 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-639b5852-69d4-4a99-9811-8c3e19072037 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.191297 Jun 06 20:48:04.156061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 327/647] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:03 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:04.161618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:04.162243 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:04.169217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:04.169665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:04.170443 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:04.170872 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:04.347119 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:04.358633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6fe6e182-5117-4972-9e46-73f9fa96c65a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.200558 Jun 06 20:48:04.359378 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 328/648] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:04 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:04.448735 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4c0175b3-bf15-42d2-80b8-5b8d8a2894b5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 204 len: 0 microversion: 2.1 time: 0.487942 Jun 06 20:48:04.449320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 321/649] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:48:03 2022] DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:48:04.459328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:04.460265 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:04.469313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:04.469755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:04.470633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:04.471157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:04.634861 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:04.643192 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0a545e27-1c5d-4c48-bc97-d93fcacb04e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.189248 Jun 06 20:48:04.643800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 329/650] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:04 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:05.175127 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:05.175852 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:05.182374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.182828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.183597 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.184128 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.317198 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:05.325740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:05.327234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:05.328424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3de4450a-4e59-46eb-916b-1549c6fccc2b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.157721 Jun 06 20:48:05.328977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 322/651] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:05 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:05.376969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:05.377602 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:05.384270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.384713 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.385478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.385905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.528549 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:05.536041 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ae3903f6-1276-4e53-ba98-690761025f1a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.162931 Jun 06 20:48:05.536615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 330/652] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:05 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:05.661194 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:05.661798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:05.667876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.668324 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.669098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.669530 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.759938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-c7ddbd3b-e22a-469c-ac5c-b7a1f7c0118d req-fbc47f44-850b-43f7-83ae-b1e985f348a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "name": "network-vif-unplugged", "status": "completed", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:05.769010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-c7ddbd3b-e22a-469c-ac5c-b7a1f7c0118d req-fbc47f44-850b-43f7-83ae-b1e985f348a5 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:05.769704 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-c7ddbd3b-e22a-469c-ac5c-b7a1f7c0118d req-fbc47f44-850b-43f7-83ae-b1e985f348a5 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:05.781372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.compute.server_external_events [req-c7ddbd3b-e22a-469c-ac5c-b7a1f7c0118d req-fbc47f44-850b-43f7-83ae-b1e985f348a5 service nova] Unable to find a host for instance a684536b-660f-47af-b824-2970df61db1d. Dropping event network-vif-unplugged {{(pid=124579) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 20:48:05.782270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-c7ddbd3b-e22a-469c-ac5c-b7a1f7c0118d req-fbc47f44-850b-43f7-83ae-b1e985f348a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028625 Jun 06 20:48:05.782858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 331/653] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 06 20:48:05.808045 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:05.815823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-61f498ea-2424-4ef7-a083-5c615416760a tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.158399 Jun 06 20:48:05.823129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 323/654] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:05 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:06.347998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:06.351175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:06.355977 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.356500 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.357386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.357893 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.505068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:06.514123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:06.515923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:06.517091 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f753b29b-7871-4faf-81b7-0ac56662ec64 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.173119 Jun 06 20:48:06.517665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 332/655] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:06 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:06.552809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:06.553423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:06.560771 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.561229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.562011 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.562455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.707873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:06.716696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e058ac3f-dcaa-4c7e-9b0c-b7e356a0f621 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.167965 Jun 06 20:48:06.717386 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 324/656] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:06 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:06.834052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:06.835248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:06.842019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.842461 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.843223 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:06.843650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:06.984156 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:06.993267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7ba3d298-285e-4eef-9f84-8ba816098723 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.162528 Jun 06 20:48:07.003029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 333/657] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:06 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:07.536999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:07.537557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:07.544760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:07.545239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:07.546079 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:07.546473 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:07.687352 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:07.698851 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:07.701537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:07.703062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-61f8dfdf-4b64-4b70-973c-262d65749904 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.170254 Jun 06 20:48:07.704565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 325/658] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:07 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:07.735763 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:07.736383 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:07.748483 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:07.753235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:07.753235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:07.753235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:07.939494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:07.948908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-323e249e-b041-42b2-b976-60fee2917450 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.216832 Jun 06 20:48:07.949506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 334/659] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:07 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:08.011162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:08.011816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:08.024778 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.025249 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:08.026066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.026503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:08.194783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:08.205028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-15625753-3527-43ff-b6b4-c3ab1e2da4e5 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.198326 Jun 06 20:48:08.205709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 326/660] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:08 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:08.722244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:08.722936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:08.729415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.729855 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:08.730626 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.731056 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:08.925606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:08.936552 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:08.939138 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:08.940564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ca18a09c-7651-45a7-a971-cd6db7e815ed tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.222196 Jun 06 20:48:08.953412 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 335/661] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:08 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:08.967354 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:08.968000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:08.987024 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.987429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:08.988202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:08.992413 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.090053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-137922671"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:09.090711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:09.098335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.099202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.100262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.100878 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.270363 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.network.security_group_api [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Removing security group b717f32e-b872-455f-9652-68ec84efa1c7 from port fe264bdd-5f81-4d3b-97d0-61b06b165535 Jun 06 20:48:09.437763 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:09.479031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e166ad5a-04c1-4cf4-88aa-154dbcdf72e8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.515721 Jun 06 20:48:09.485141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 327/662] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:08 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:09.493615 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:09.494496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:09.501144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.502059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.503029 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.503654 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.683253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:09.691979 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d73e00a3-9839-4997-bf80-011a14a1cea6 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.205502 Jun 06 20:48:09.700169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 328/663] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:09 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:09.963932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:09.979348 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:09.994291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.995589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:09.997139 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:09.997874 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.032122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:10.118465 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7f305105-70b5-4426-9157-e067cb22cfaf tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action" status: 202 len: 0 microversion: 2.1 time: 1.035417 Jun 06 20:48:10.123227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 336/664] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 20:48:09 2022] POST /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:48:10.432655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:10.446995 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:10.455298 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:10.459216 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3b060392-81a1-4371-b1e3-7248419732e9 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.499440 Jun 06 20:48:10.459216 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 329/665] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:09 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:10.497894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:10.498738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:10.510944 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:10.511849 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.516496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:10.517181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.545475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-885f125b-7b8a-49dc-94f3-7e69a4b97779 req-0b2140bd-bee6-4cde-b722-aa72ac033216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:10.559332 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-885f125b-7b8a-49dc-94f3-7e69a4b97779 req-0b2140bd-bee6-4cde-b722-aa72ac033216 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:10.564966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-885f125b-7b8a-49dc-94f3-7e69a4b97779 req-0b2140bd-bee6-4cde-b722-aa72ac033216 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.603776 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-885f125b-7b8a-49dc-94f3-7e69a4b97779 req-0b2140bd-bee6-4cde-b722-aa72ac033216 service nova] Creating event network-changed:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:48:10.621817 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-885f125b-7b8a-49dc-94f3-7e69a4b97779 req-0b2140bd-bee6-4cde-b722-aa72ac033216 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477750 Jun 06 20:48:10.623534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 337/666] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:10.715128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:10.716143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:10.725274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:10.726080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.730860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:10.731724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:10.940159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:10.950584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-85874df6-198d-46df-b172-0f9fd2fd605a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1517 microversion: 2.1 time: 0.456642 Jun 06 20:48:10.955084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 330/667] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:10 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1517 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:11.221794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:11.238801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3dc57505-1d1b-4419-af83-c0da7a677b00 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1674 microversion: 2.1 time: 0.526848 Jun 06 20:48:11.238801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 338/668] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:10 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1674 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:11.476696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:11.478226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:11.491113 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:11.492320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:11.494198 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:11.494936 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:11.901029 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:11.925098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:11.928001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:11.932332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fa0e0a81-c2b4-41bd-b520-7e88edd4cd4a tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.460334 Jun 06 20:48:11.933596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 331/669] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:11 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:11.972875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:11.973987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:11.989860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:11.990539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:11.991816 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:11.993334 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:12.254964 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:12.255795 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:12.272382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:12.272828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:12.274141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:12.274759 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:12.330280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:12.339949 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2d497697-c0de-4bf6-a6bc-97e271139938 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1519 microversion: 2.1 time: 0.371067 Jun 06 20:48:12.341006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 339/670] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:11 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:12.448620 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:12.456995 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c1c4b671-db9f-4e71-9ec0-f88b9645a10e tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1607 microversion: 2.1 time: 0.207321 Jun 06 20:48:12.470310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 332/671] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:12 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1607 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:12.868782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:12.922699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:12.922699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:12.922699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:12.922699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:12.923873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.068063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lazy-loading 'services' on Instance uuid a5e62889-cdad-418d-94ae-d0412c475579 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:48:13.158087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-3b7a16e7-c635-437b-97df-2dc0d7ff723b req-ef0173c5-a8d2-4820-b16a-f621eaf340a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:13.189166 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-3b7a16e7-c635-437b-97df-2dc0d7ff723b req-ef0173c5-a8d2-4820-b16a-f621eaf340a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:13.196567 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-3b7a16e7-c635-437b-97df-2dc0d7ff723b req-ef0173c5-a8d2-4820-b16a-f621eaf340a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.246338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-3b7a16e7-c635-437b-97df-2dc0d7ff723b req-ef0173c5-a8d2-4820-b16a-f621eaf340a8 service nova] Creating event network-changed:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:48:13.263275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-3b7a16e7-c635-437b-97df-2dc0d7ff723b req-ef0173c5-a8d2-4820-b16a-f621eaf340a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393400 Jun 06 20:48:13.270797 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 333/672] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:48:13.288167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:13.289437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:13.305286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:13.306637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.308982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:13.314842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.762406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0d579a81-f0a0-4a9a-8576-f245eb953fcb tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments/0aca9f3e-fb03-41a1-be00-8cd87c24aba3" status: 202 len: 0 microversion: 2.1 time: 0.904115 Jun 06 20:48:13.772451 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 340/673] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:48:12 2022] DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments/0aca9f3e-fb03-41a1-be00-8cd87c24aba3 => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:48:13.776475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-75f3d8b4-51f7-45b7-b396-dd291397e458 req-74c06f2b-cc26-498d-a0bc-ddb2753665b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a253f5a-4a96-4b83-b854-a41081156f1f", "name": "network-vif-deleted", "tag": "023f96ea-b1c9-42a8-b7df-1571b32ec938"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:13.815274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-75f3d8b4-51f7-45b7-b396-dd291397e458 req-74c06f2b-cc26-498d-a0bc-ddb2753665b0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:13.823798 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-75f3d8b4-51f7-45b7-b396-dd291397e458 req-74c06f2b-cc26-498d-a0bc-ddb2753665b0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.869683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-75f3d8b4-51f7-45b7-b396-dd291397e458 req-74c06f2b-cc26-498d-a0bc-ddb2753665b0 service nova] Creating event network-vif-deleted:023f96ea-b1c9-42a8-b7df-1571b32ec938 for instance 4a253f5a-4a96-4b83-b854-a41081156f1f on hv-cinder-84487 Jun 06 20:48:13.902551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-75f3d8b4-51f7-45b7-b396-dd291397e458 req-74c06f2b-cc26-498d-a0bc-ddb2753665b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134788 Jun 06 20:48:13.904351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 341/674] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:13.928305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:13.949404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:13.953076 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:13.956820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:13.957584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:13.963681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c3ef3933-be2a-49bc-b2fc-386b0ac36e0b tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.688443 Jun 06 20:48:13.964509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 334/675] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:13 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:13.982910 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:13.988829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:13.996857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:13.997344 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:13.998116 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.004067 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.005561 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:14.010706 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.019371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:14.019813 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:14.249560 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:14.259867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1f9bbdfa-2982-41ab-b3e3-8c5a3288959d tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1322 microversion: 2.1 time: 0.292256 Jun 06 20:48:14.260449 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 335/676] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:13 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:14.265559 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:14.279688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:14.294283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.294283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:14.294283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.294283 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:14.373649 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e0cd8491-0121-4e15-b72d-453717029d8a tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111940 Jun 06 20:48:14.374872 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 336/677] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:14 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:14.447079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:14.456484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-aa8bdda4-664f-44db-a498-e7892e30d6aa tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.547582 Jun 06 20:48:14.456959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 342/678] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:13 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:14.986486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:14.987245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:14.997766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:14.999258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.004255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.004255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.278933 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:15.280724 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:15.313434 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=76 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:15.317512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.319655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.324085 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.325581 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.354697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:15.374828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.375642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.376428 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'fault' on Instance uuid 4a253f5a-4a96-4b83-b854-a41081156f1f {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:48:15.438072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:15.449942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2c31b35e-d70e-4874-abbb-9f4de0c63d85 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1327 microversion: 2.1 time: 0.176654 Jun 06 20:48:15.450654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 343/679] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:15 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1327 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:15.465657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:15.467087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:15.476441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.477003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.477884 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.478423 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.516263 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:15.523042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-cbefee57-9bab-4088-8e1f-4808b9e2b0bd tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061337 Jun 06 20:48:15.527061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 344/680] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:15 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:15.532092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:15.536788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:15.536930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:15.536930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:15.538484 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-22f0e26b-f923-43f5-a4a1-73c96ea118ee tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.555930 Jun 06 20:48:15.539729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 337/681] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:14 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:15.543944 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.544565 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.545359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:15.546022 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:15.712622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:15.720388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1e1aa94d-216a-49ca-ae2e-56e441848974 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.192557 Jun 06 20:48:15.720959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 345/682] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:15 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:16.467047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:16.467773 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:16.470881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:16.475869 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.476322 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.477098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.477539 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.508976 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.509422 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.509878 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lazy-loading 'fault' on Instance uuid 4a253f5a-4a96-4b83-b854-a41081156f1f {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:48:16.534851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:16.535979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:16.544811 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.545604 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.546655 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.547308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.555494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ab3ebbc9a4a429e5df2a616f305f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1af880b45d426aa752589183354a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:16.566333 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-42c25059-8002-4bdd-a690-54f62d727f62 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 200 len: 1327 microversion: 2.1 time: 0.102943 Jun 06 20:48:16.571734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 338/683] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:16 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:16.574071 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:16.576183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:16.581969 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.582679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.584544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.585199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.589250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5f9c63a8-17ae-44f2-96c0-96ce95b52fb2 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058653 Jun 06 20:48:16.589850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 346/684] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:16 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:16.737922 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:16.738979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:16.746338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.747018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:16.748090 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:16.749160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.016229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:17.033069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f772187f-15a8-46c2-8487-924e66f17b29 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.298876 Jun 06 20:48:17.045823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 347/685] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:16 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:17.308834 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:17.319269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:17.321099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:17.322733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-64321791-a122-4461-9812-8c4d41ffe7e5 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.753320 Jun 06 20:48:17.323395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 339/686] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:16 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:17.583720 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:17.584350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:17.591581 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.592061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.592853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.593284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.604106 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:17.606175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f HTTP/1.1 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:48:17.614335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:17.616183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '4a253f5a-4a96-4b83-b854-a41081156f1f'} Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:17.617124 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:17.618703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.620470 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:17.620470 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-67ff059a-133e-4135-834c-ab95394c860b tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 404 len: 111 microversion: 2.1 time: 0.035521 Jun 06 20:48:17.620666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.620666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.620864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 348/687] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:17 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:17.621713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.622448 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.624931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5b805af5-cc4f-478d-9b50-5de09bced21f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '.version_select at 0x7fdaea1ef550>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:17.662519 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a7283758-a9f1-489c-af36-fd2cb0b2a16c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064965 Jun 06 20:48:17.663250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 340/688] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:48:17 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:48:17.673882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:17.677335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:17.681142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.681697 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.682691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:17.683199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:17.694935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5b805af5-cc4f-478d-9b50-5de09bced21f tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117475891" status: 202 len: 0 microversion: 2.1 time: 0.073631 Jun 06 20:48:17.695696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 349/689] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 20:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117475891 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:48:17.813477 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] HTTP exception thrown: Instance a5e62889-cdad-418d-94ae-d0412c475579 is not attached to volume 0aca9f3e-fb03-41a1-be00-8cd87c24aba3 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Request method failure captured: Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments/0aca9f3e-fb03-41a1-be00-8cd87c24aba3 HTTP/1.1 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmdt93BMA1TzUUVxgCU2kKc_FQh-MT_E8KGFA7IKjI28ecTeQ659-Gkna-yLW-5OT-hNNF3V-kwDzEfOHWRG_uBfZKLdbofkCEnKfCYNSPxC3dhuqhtu-Tk-vkOz3Hj7hcA-DwR1ZDuPUXx00jjyEXxfJ4n6hTE7kwYSq2KujkNq9nM Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 64507ac6234948fba1aa5c64216b7a1e Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:48:17.825234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_64507ac6234948fba1aa5c64216b7a1e", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 64507ac6234948fba1aa5c64216b7a1e Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-TestMinimumBasicScenario-1257517278-project Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: e826d6287bd34267b9614b94b1cd41e2 Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-TestMinimumBasicScenario-1257517278-project Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:48:17.826674 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance a5e62889-cdad-418d-94ae-d0412c475579 is not attached to volume 0aca9f3e-fb03-41a1-be00-8cd87c24aba3 Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'server_id': 'a5e62889-cdad-418d-94ae-d0412c475579', 'id': '0aca9f3e-fb03-41a1-be00-8cd87c24aba3'} Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0aca9f3e-fb03-41a1-be00-8cd87c24aba3. Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:17.827421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e62889-cdad-418d-94ae-d0412c475579 is not attached to volume 0aca9f3e-fb03-41a1-be00-8cd87c24aba3 Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e62889-cdad-418d-94ae-d0412c475579 is not attached to volume 0aca9f3e-fb03-41a1-be00-8cd87c24aba3 Jun 06 20:48:17.828659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:17.830981 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Returning 404 to user: Instance a5e62889-cdad-418d-94ae-d0412c475579 is not attached to volume 0aca9f3e-fb03-41a1-be00-8cd87c24aba3 {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:17.832131 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-247fab57-1b68-4799-b64c-156f7c813b1e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments/0aca9f3e-fb03-41a1-be00-8cd87c24aba3" status: 404 len: 154 microversion: 2.1 time: 0.162479 Jun 06 20:48:17.840736 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 341/690] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:48:17 2022] DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579/os-volume_attachments/0aca9f3e-fb03-41a1-be00-8cd87c24aba3 => generated 154 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:18.051840 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:18.052464 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:18.077206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:18.077206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:18.077206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:18.077206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:18.252140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:18.272042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2236ebab-0534-40d6-859c-82a4bfd69e65 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.224253 Jun 06 20:48:18.283271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 350/691] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:18 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:18.342592 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:18.345152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:18.358911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:18.363829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:18.368098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:18.368893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:18.679175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:18.692214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:18.694168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:18.695413 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cb34e7ec-eb79-43e0-bc29-fa373f0f2df0 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.358244 Jun 06 20:48:18.695999 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 342/692] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:18 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:48:19.204737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:19.205784 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:19.214213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.221478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.221478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.221478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.244918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Going to try to terminate instance {{(pid=124579) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:48:19.290222 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:19.290828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:19.297513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.297960 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.298914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.299637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.538926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:19.550644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5aa30e17-8c1d-4824-b1ca-b5e33d3e88ef tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.264747 Jun 06 20:48:19.551273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 343/693] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:19 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:19.562625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2fac7b0c-ee10-494f-8533-6f793109b744 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 204 len: 0 microversion: 2.1 time: 0.356301 Jun 06 20:48:19.562625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 351/694] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:48:19 2022] DELETE /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:48:19.575907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:19.576694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:19.584658 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.585397 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.586979 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.587491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.717232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:19.719315 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:19.727344 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.728571 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.729858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.730462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.737425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:19.748532 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3ed4ae4f-dafc-4521-8f00-0740ea35424c tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1554 microversion: 2.1 time: 0.177901 Jun 06 20:48:19.763599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 352/695] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:19 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:19.915039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-df96c3ff-b102-490d-89bd-ef7a9618ada5 req-50af2ce0-9ab8-4e95-a2fc-99347b9125ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "name": "network-vif-plugged", "status": "completed", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:19.924463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-df96c3ff-b102-490d-89bd-ef7a9618ada5 req-50af2ce0-9ab8-4e95-a2fc-99347b9125ef service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:19.924905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-df96c3ff-b102-490d-89bd-ef7a9618ada5 req-50af2ce0-9ab8-4e95-a2fc-99347b9125ef service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:19.938554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-df96c3ff-b102-490d-89bd-ef7a9618ada5 req-50af2ce0-9ab8-4e95-a2fc-99347b9125ef service nova] Creating event network-vif-plugged:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:48:19.943822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-df96c3ff-b102-490d-89bd-ef7a9618ada5 req-50af2ce0-9ab8-4e95-a2fc-99347b9125ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Jun 06 20:48:19.944420 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 353/696] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:19.967952 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:19.979509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:19.981335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:19.983060 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6924997a-e9d3-4fab-a41e-f866ab0ce01e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.273257 Jun 06 20:48:19.983631 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 344/697] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:19 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:48:20.571548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:20.572401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:20.585389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:20.586715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:20.587775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:20.588456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:20.751605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:20.759567 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-07d39bdb-4824-42ee-9484-6e323ec77151 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.193005 Jun 06 20:48:20.760198 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 354/698] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:20 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:20.774691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:20.775301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:20.782226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:20.785424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:20.785424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:20.785424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.005285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:21.006117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:21.015325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.015325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.015815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.016456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.050360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:21.060614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f2c0d1a7-834c-4136-b9b1-e066947aa73e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1554 microversion: 2.1 time: 0.290163 Jun 06 20:48:21.061991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 345/699] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:20 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:21.172699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:21.183985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:21.186117 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:21.187603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-23229065-3223-4486-ad5f-1f76e948d1ef tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.190299 Jun 06 20:48:21.188315 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 355/700] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:20 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:48:21.592074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:21.592777 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:21.600743 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.602005 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.602793 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.603224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.624831 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=100 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:21.629189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f HTTP/1.1 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:48:21.630709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.632073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '4a253f5a-4a96-4b83-b854-a41081156f1f'} Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:21.632927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.634144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.639110 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:21.639110 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-785297fc-5661-4ea0-bb5b-4893f487e571 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 404 len: 111 microversion: 2.1 time: 0.045184 Jun 06 20:48:21.639110 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 346/701] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:48:21 2022] DELETE /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:21.645568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:21.646751 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 4a253f5a-4a96-4b83-b854-a41081156f1f] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:21.656637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.658083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.660169 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.660784 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.679349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f HTTP/1.1 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:48:21.681069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.682630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '4a253f5a-4a96-4b83-b854-a41081156f1f'} Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:21.687304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. Jun 06 20:48:21.688534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:21.689612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 4a253f5a-4a96-4b83-b854-a41081156f1f could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:21.689612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8ec1e26d-5fcf-42e8-a457-ac83a06496fc tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f" status: 404 len: 111 microversion: 2.1 time: 0.042204 Jun 06 20:48:21.689612 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 356/702] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:21 2022] GET /compute/v2.1/servers/4a253f5a-4a96-4b83-b854-a41081156f1f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:21.778117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:21.778638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:21.785732 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.786466 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:21.787245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:21.787740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.078634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:22.079461 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:22.088621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.092271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.092271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.092271 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.109691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:22.119406 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d1c39c0a-7405-4295-b7a8-ae561d0dfdf0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.346944 Jun 06 20:48:22.123480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 347/703] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:21 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:22.184546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:22.207179 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:22.207957 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:22.212179 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f6f6e760-cc2c-4387-a184-581a50fcd21d tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1512 microversion: 2.1 time: 0.137420 Jun 06 20:48:22.218458 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.219009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.220744 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 357/704] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:22 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:22.222440 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.223339 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.274539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-e5bcd4c7-976d-401a-a293-cb89ae7a94bb req-c7ed24e3-2537-453d-9b2d-9ff7f169e3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e62889-cdad-418d-94ae-d0412c475579", "name": "network-vif-deleted", "tag": "fe264bdd-5f81-4d3b-97d0-61b06b165535"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:22.288416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-e5bcd4c7-976d-401a-a293-cb89ae7a94bb req-c7ed24e3-2537-453d-9b2d-9ff7f169e3f7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.288416 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-e5bcd4c7-976d-401a-a293-cb89ae7a94bb req-c7ed24e3-2537-453d-9b2d-9ff7f169e3f7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.301800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-e5bcd4c7-976d-401a-a293-cb89ae7a94bb req-c7ed24e3-2537-453d-9b2d-9ff7f169e3f7 service nova] Creating event network-vif-deleted:fe264bdd-5f81-4d3b-97d0-61b06b165535 for instance a5e62889-cdad-418d-94ae-d0412c475579 on hv-cinder-84487 Jun 06 20:48:22.308227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-e5bcd4c7-976d-401a-a293-cb89ae7a94bb req-c7ed24e3-2537-453d-9b2d-9ff7f169e3f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039656 Jun 06 20:48:22.309368 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 358/705] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:22.426619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:22.440124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:22.442122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:22.447355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7e6ef558-c275-4c68-a8cb-71ec21e157fc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.240772 Jun 06 20:48:22.447355 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 348/706] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:22 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:48:22.967601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:22.968313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:22.977321 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.977948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:22.979099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:22.980178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.004959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 HTTP/1.1 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:48:23.006624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.014853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '46cd0208-5f22-427d-95a0-100597554481'} Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:23.015796 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.017274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.018701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:23.018701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-653945f9-b94a-4c3c-9929-3e274d1f0f56 tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 404 len: 111 microversion: 2.1 time: 0.046776 Jun 06 20:48:23.018701 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 359/707] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:48:22 2022] DELETE /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:23.025554 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:23.026434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] [instance: 46cd0208-5f22-427d-95a0-100597554481] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:23.045718 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.045718 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.045718 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.045718 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.052251 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] HTTP exception thrown: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Request method failure captured: Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 HTTP/1.1 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmayunI6h-yPzZEbhlVn3u8FIG2pX8_3hJ2vyWllZpRT2LxjczqsNtWPGlzFf2o2gy7tn0PdHqHHX0ba178iLyW7b7FMT1Kgn1b1npm1lrGNkhNuNGcziLEIADqodHXo3Yq7j2kIxaucUr2jnWUoiOYVVGFFQIJhlV0nwqGRDLtx7IU Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:48:23.053828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3a1af880b45d426aa752589183354a77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3a1af880b45d426aa752589183354a77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3a1af880b45d426aa752589183354a77", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 3a1af880b45d426aa752589183354a77 Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1296112348 Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: a47ab3ebbc9a4a429e5df2a616f305f0 Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeTestJSON-1296112348-project Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.055781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '46cd0208-5f22-427d-95a0-100597554481'} Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:23.056551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. Jun 06 20:48:23.058140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:48:23.059313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] Returning 404 to user: Instance 46cd0208-5f22-427d-95a0-100597554481 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:23.059313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c5a12012-e2a9-44b4-be60-a677ca7bc88c tempest-AttachVolumeTestJSON-1296112348 tempest-AttachVolumeTestJSON-1296112348-project] 10.222.0.41 "GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481" status: 404 len: 111 microversion: 2.1 time: 0.037356 Jun 06 20:48:23.059313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 349/708] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:23 2022] GET /compute/v2.1/servers/46cd0208-5f22-427d-95a0-100597554481 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:23.141438 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:23.142320 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:23.150947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.151626 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.152653 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.153170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.232922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:23.233835 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:23.245661 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.249192 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.250022 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.250474 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.343638 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.344120 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.344590 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lazy-loading 'fault' on Instance uuid a5e62889-cdad-418d-94ae-d0412c475579 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:48:23.351068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:23.360761 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9efb4492-73de-40dd-86b2-5aa849624379 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.225989 Jun 06 20:48:23.361543 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 360/709] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:23 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:23.421568 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826d6287bd34267b9614b94b1cd41e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64507ac6234948fba1aa5c64216b7a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:23.430279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8b5d9cc4-bd86-4859-9dbf-c1c07b645bf5 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 200 len: 1348 microversion: 2.1 time: 0.203436 Jun 06 20:48:23.436299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 350/710] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:23 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 1348 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:23.469742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:23.471418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:23.479386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.480676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.481551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:23.482070 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:23.642076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:23.651891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:23.653731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:23.655095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0674001b-6717-429b-8bf4-e036f0e75b28 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1730 microversion: 2.20 time: 0.190497 Jun 06 20:48:23.666409 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 361/711] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:23 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:48:24.382824 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:24.384164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:24.391961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.394959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.394959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.394959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.447984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:24.449359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] [instance: a5e62889-cdad-418d-94ae-d0412c475579] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:24.456606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.457227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.458170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.458904 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.464309 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:24.480087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] HTTP exception thrown: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Request method failure captured: Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 HTTP/1.1 Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmdt93BMA1TzUUVxgCU2kKc_FQh-MT_E8KGFA7IKjI28ecTeQ659-Gkna-yLW-5OT-hNNF3V-kwDzEfOHWRG_uBfZKLdbofkCEnKfCYNSPxC3dhuqhtu-Tk-vkOz3Hj7hcA-DwR1ZDuPUXx00jjyEXxfJ4n6hTE7kwYSq2KujkNq9nM Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 64507ac6234948fba1aa5c64216b7a1e Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:48:24.481966 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/64507ac6234948fba1aa5c64216b7a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_64507ac6234948fba1aa5c64216b7a1e", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 64507ac6234948fba1aa5c64216b7a1e Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257517278 Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestMinimumBasicScenario-1257517278-project Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: e826d6287bd34267b9614b94b1cd41e2 Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestMinimumBasicScenario-1257517278-project Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. Jun 06 20:48:24.483417 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'a5e62889-cdad-418d-94ae-d0412c475579'} Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:48:24.484273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. Jun 06 20:48:24.485491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:48:24.488664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Returning 404 to user: Instance a5e62889-cdad-418d-94ae-d0412c475579 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:48:24.490137 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8c32cf43-e5da-45a8-aa27-e73a2e0d0626 tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579" status: 404 len: 111 microversion: 2.1 time: 0.046384 Jun 06 20:48:24.491249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 362/712] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:24 2022] GET /compute/v2.1/servers/a5e62889-cdad-418d-94ae-d0412c475579 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:48:24.500037 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-09afe7d3-904f-4fd9-b993-50541f45110e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] Calling method '.version_select at 0x7fdaea22a9d0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:24.628161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-09afe7d3-904f-4fd9-b993-50541f45110e tempest-TestMinimumBasicScenario-1257517278 tempest-TestMinimumBasicScenario-1257517278-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777834900" status: 202 len: 0 microversion: 2.1 time: 0.125497 Jun 06 20:48:24.628161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 363/713] 10.222.0.41 () {58 vars in 1268 bytes} [Mon Jun 6 20:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777834900 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:48:24.674203 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:24.675907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:24.695517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.695517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.695517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:24.695517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:24.708669 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:24.727276 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2c85f8ae-50d7-4d45-a1fb-d016198252c0 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.350044 Jun 06 20:48:24.731566 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 351/714] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:24 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:24.922987 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:24.936161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:24.937646 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:24.939808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-39d7a8a3-3ee8-4945-94ec-286895e8750e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1717 microversion: 2.20 time: 0.269169 Jun 06 20:48:24.940557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 364/715] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:48:24 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1717 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:48:25.746042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:25.746565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:25.754016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:25.754016 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:25.754644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:25.755269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:26.086877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:26.098325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8976f654-794f-4d82-82ec-75b55ee05a66 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.353740 Jun 06 20:48:26.104366 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 352/716] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:25 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:27.136310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:27.138003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:27.152717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:27.153490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:27.160859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:27.160859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:27.806130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:27.815301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fda741a5-9a9a-4c8c-ae5c-61fef5b94e8a tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.703954 Jun 06 20:48:27.816296 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 365/717] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:27 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:28.240582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-fcd08a93-b462-4960-8e0a-3f05ff0b0022 req-35eb2085-c706-432a-be8b-e876e54afa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "name": "network-vif-plugged", "status": "completed", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:28.262929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-fcd08a93-b462-4960-8e0a-3f05ff0b0022 req-35eb2085-c706-432a-be8b-e876e54afa39 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:28.262929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-fcd08a93-b462-4960-8e0a-3f05ff0b0022 req-35eb2085-c706-432a-be8b-e876e54afa39 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:28.294516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-fcd08a93-b462-4960-8e0a-3f05ff0b0022 req-35eb2085-c706-432a-be8b-e876e54afa39 service nova] Creating event network-vif-plugged:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:48:28.307899 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-fcd08a93-b462-4960-8e0a-3f05ff0b0022 req-35eb2085-c706-432a-be8b-e876e54afa39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071919 Jun 06 20:48:28.308876 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 353/718] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:28.833391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:28.834678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:28.850062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:28.852533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:28.855691 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:28.856372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:29.118346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:29.130318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-20fa1641-5be6-4621-8720-0c594571b0de tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.300674 Jun 06 20:48:29.131219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 366/719] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:28 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:30.150085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:30.150746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:30.173457 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:30.178588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:30.178588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:30.178588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:30.458255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:30.467579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ae67a129-0631-4d35-9d04-c47e4d6c13fb tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1575 microversion: 2.1 time: 0.323211 Jun 06 20:48:30.479526 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 354/720] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:30 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1575 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:31.426062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-85c5c157-2332-4d0b-9a73-cdf6569330ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Action: 'create', calling method: .version_select at 0x7fdaea382670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1910891760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQvN+Txe9KZLEy8GeFBPqQ0bpKgsRbWeXJGMJishKwogJ2YMjPRpJGm3yOrT/oIMGP6cNrI93gZCkQpvuhfSr4EhEHToq30HFp4fKRDPlrTVkXS+W2xqg/T2YV3ubsg0A=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:31.450234 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-85c5c157-2332-4d0b-9a73-cdf6569330ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:48:31.454841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-85c5c157-2332-4d0b-9a73-cdf6569330ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for user 2bb3e3fc9a494cdf8abd264038af044c and project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:48:31.494221 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:31.494868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:31.502321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:31.502990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:31.503913 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:31.504427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:31.557548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-85c5c157-2332-4d0b-9a73-cdf6569330ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.429632 Jun 06 20:48:31.558491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 367/721] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:48:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:31.750616 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:31.762499 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-38784f8c-17b9-44fa-b9fa-e8259ce67112 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1562 microversion: 2.1 time: 0.272892 Jun 06 20:48:31.763546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 355/722] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:31 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:40.300727 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=19 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:40.457348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-11f252f9-b564-4b4a-9d7b-f83cf1806311 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: .version_select at 0x7fdaef518c10>, body: {"keypair": {"name": "tempest-keypair-1147233555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCms2rTkg3WX4b5PUIHzLaj6QrAjRaxFS9UjzsmKZpIHRAyOlCZDPRp3tU8C7P85FXbr8Y6NBiXcIuWCNqlmWffowygoQezQssL3zSESXcQaCERmsyDd1YNiFPq5F1DbFw=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:40.478381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-11f252f9-b564-4b4a-9d7b-f83cf1806311 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:48:40.481548 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-11f252f9-b564-4b4a-9d7b-f83cf1806311 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:48:40.638071 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-11f252f9-b564-4b4a-9d7b-f83cf1806311 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338715 Jun 06 20:48:40.639425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 368/723] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:48:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:43.128554 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-72830750", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba219d3c-acea-4b6a-9365-0ffc461448ec"}], "security_groups": [{"name": "tempest-securitygroup--645890662"}], "key_name": "tempest-keypair-1147233555", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:43.136642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=39 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:43.137313 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=48 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:43.233901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] validate_networks() for [('ba219d3c-acea-4b6a-9365-0ffc461448ec', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:48:43.717193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:48:43.717728 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:48:43.718390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:48:43.718812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:48:43.719374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:48:43.732926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:43.733582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:43.734282 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:43.735209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:43.753885 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:48:43.757778 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:48:43.770501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:48:43.771165 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:48:43.915729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-04ca7c3d-afe8-4ef2-84cc-f82e1e0e66e9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792273 Jun 06 20:48:43.916754 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 356/724] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:48:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:48:43.929531 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4e47d248-1574-4325-94bd-49a216e6ecfc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:43.935852 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4e47d248-1574-4325-94bd-49a216e6ecfc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:44.020374 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4e47d248-1574-4325-94bd-49a216e6ecfc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:44.020374 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4e47d248-1574-4325-94bd-49a216e6ecfc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1240 microversion: 2.1 time: 0.082492 Jun 06 20:48:44.020374 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 369/725] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:43 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:45.027535 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-67419cd9-69be-4d5f-a28d-b5353561dec7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:45.041523 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-67419cd9-69be-4d5f-a28d-b5353561dec7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:45.118756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-67419cd9-69be-4d5f-a28d-b5353561dec7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:45.127068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-67419cd9-69be-4d5f-a28d-b5353561dec7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1240 microversion: 2.1 time: 0.105120 Jun 06 20:48:45.127068 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 357/726] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:45 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:46.143202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:46.143847 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:46.146142 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:46.151899 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:46.152425 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:46.153498 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:46.154133 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:46.216918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:46.224893 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-cab1e56f-bc36-4e93-b572-234689472e62 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1292 microversion: 2.1 time: 0.085739 Jun 06 20:48:46.226132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 370/727] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:46 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:47.244940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:47.245407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:47.252196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:47.252695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:47.253472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:47.253980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:47.325553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:47.333112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-15b094f4-5b2a-4857-b39b-5cbe0b259818 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1298 microversion: 2.1 time: 0.093093 Jun 06 20:48:47.333671 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 358/728] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:47 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:48.355008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:48.355754 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:48.366900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:48.367618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:48.368699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:48.369319 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:48.500957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:48.508798 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4329ed35-bd84-4933-afdf-1230cb98b8b9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.158318 Jun 06 20:48:48.518240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 371/729] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:48 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:48.839981 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-1a651d34-435f-4023-8ff5-d86b7c2cdc52 req-05d32d6a-b618-4cc6-8611-3b524671d1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f732c9-6be3-4383-8911-145cfc0de38e", "tag": "ef6e2094-a459-4ff3-bf71-d276d51530f9"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:48.850463 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1a651d34-435f-4023-8ff5-d86b7c2cdc52 req-05d32d6a-b618-4cc6-8611-3b524671d1a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:48.851347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1a651d34-435f-4023-8ff5-d86b7c2cdc52 req-05d32d6a-b618-4cc6-8611-3b524671d1a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:48.870325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-1a651d34-435f-4023-8ff5-d86b7c2cdc52 req-05d32d6a-b618-4cc6-8611-3b524671d1a8 service nova] Creating event network-changed:ef6e2094-a459-4ff3-bf71-d276d51530f9 for instance d2f732c9-6be3-4383-8911-145cfc0de38e on hv-cinder-84487 Jun 06 20:48:48.875459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-1a651d34-435f-4023-8ff5-d86b7c2cdc52 req-05d32d6a-b618-4cc6-8611-3b524671d1a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040487 Jun 06 20:48:48.876093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 359/730] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:48:49.525405 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:49.526016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:49.533130 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:49.533579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:49.534341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:49.534775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:49.665875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:49.673243 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-69f60e18-000c-4acc-a4da-664e5d9a0c37 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.151730 Jun 06 20:48:49.673830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 372/731] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:49 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:50.690612 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:50.691304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:50.697743 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:50.698196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:50.699525 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:50.699989 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:50.827529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:50.834898 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-51230fc2-f86c-48a7-b60c-43258053f3c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.148933 Jun 06 20:48:50.835440 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 360/732] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:50 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:51.851462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:51.852609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:51.859178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:51.859619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:51.860402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:51.860832 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:52.000007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:52.008034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4cde4bea-a5f8-496a-b75e-992c8745ab3f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.160214 Jun 06 20:48:52.008699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 373/733] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:51 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:53.024990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:53.025627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:53.032171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:53.032618 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:53.033434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:53.033868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:53.161820 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:53.169610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4703c04a-bf80-4b25-b499-31327c7f3779 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.148514 Jun 06 20:48:53.170183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 361/734] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:53 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:53.368504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-574460588", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1910891760", "security_groups": [{"name": "tempest-secgroup-smoke-561185832"}], "block_device_mapping_v2": [{"uuid": "d03e7fdf-dcb6-4394-b8d9-1d2f54c56833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b263e80-04f0-46e3-a24e-eb32fd6a6da0"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:53.480880 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] validate_networks() for [('8b263e80-04f0-46e3-a24e-eb32fd6a6da0', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:48:53.836778 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:48:53.837205 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:48:53.837678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:48:53.838636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:48:53.839046 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:48:53.848371 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:53.848819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:53.849622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:53.850042 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:53.866123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:48:53.870076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for user 2bb3e3fc9a494cdf8abd264038af044c and project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:48:53.928390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:48:53.930468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d03e7fdf-dcb6-4394-b8d9-1d2f54c56833',volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:48:54.172490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-49e1c9b0-b8b5-4f80-add2-230aba00c3ac req-271b5a71-e286-4957-9149-44b7eec70606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f732c9-6be3-4383-8911-145cfc0de38e", "name": "network-vif-plugged", "status": "completed", "tag": "ef6e2094-a459-4ff3-bf71-d276d51530f9"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:54.177364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:54.182619 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-49e1c9b0-b8b5-4f80-add2-230aba00c3ac req-271b5a71-e286-4957-9149-44b7eec70606 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:54.183060 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-49e1c9b0-b8b5-4f80-add2-230aba00c3ac req-271b5a71-e286-4957-9149-44b7eec70606 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:54.194627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-49e1c9b0-b8b5-4f80-add2-230aba00c3ac req-271b5a71-e286-4957-9149-44b7eec70606 service nova] Creating event network-vif-plugged:ef6e2094-a459-4ff3-bf71-d276d51530f9 for instance d2f732c9-6be3-4383-8911-145cfc0de38e on hv-cinder-84487 Jun 06 20:48:54.200704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-49e1c9b0-b8b5-4f80-add2-230aba00c3ac req-271b5a71-e286-4957-9149-44b7eec70606 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Jun 06 20:48:54.201295 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 362/735] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:48:54.206687 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:54.207199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:54.214188 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:54.214637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:54.215403 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:54.215866 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:54.303980 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4ad15611-6bfd-4b0f-b9ab-185d08981469 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938842 Jun 06 20:48:54.304639 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 374/736] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:48:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:48:54.315015 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9a133e11-b62c-4a39-a68b-688b70e5afb9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:54.315743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9a133e11-b62c-4a39-a68b-688b70e5afb9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:54.377643 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:54.380386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9a133e11-b62c-4a39-a68b-688b70e5afb9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:54.386310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ffe0089d-281c-40ba-81ff-17d9fdadbba5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.183802 Jun 06 20:48:54.387331 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 363/737] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:54 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:54.391939 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9a133e11-b62c-4a39-a68b-688b70e5afb9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1094 microversion: 2.1 time: 0.080648 Jun 06 20:48:54.392969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 375/738] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:54 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:55.403551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:55.404191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:55.406124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=8 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:48:55.409266 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:55.409855 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:55.411472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:55.411947 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:55.412712 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:55.413146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:55.416435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:55.416881 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:55.418183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:55.418621 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:55.479599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:55.488581 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-24d38823-4567-441d-a7a1-da35c7098782 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1144 microversion: 2.1 time: 0.082910 Jun 06 20:48:55.489536 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 376/739] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:55 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:55.548012 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:55.555537 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b9e5b2fc-1b9b-42e3-bf0d-f7f8908a154e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1365 microversion: 2.1 time: 0.155895 Jun 06 20:48:55.556122 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 364/740] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:55 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:56.505682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:56.506279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:56.514001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.515157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.515272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.515599 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.572472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:56.573202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:56.579627 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:56.583731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.583731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.583731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.583731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.587010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-85869485-794c-4dbd-8819-4270bd64da99 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1192 microversion: 2.1 time: 0.085142 Jun 06 20:48:56.587578 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 377/741] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:56 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:56.711922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:56.719327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7224ae71-8b75-4f97-baec-9cf197f5466d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1555 microversion: 2.1 time: 0.151254 Jun 06 20:48:56.719924 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 365/742] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:56 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:48:56.735212 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:56.735726 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:56.741566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.742008 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.742761 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:56.743192 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:56.820411 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7faab0f2-46e6-45b7-bc50-3f1e545f189d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088925 Jun 06 20:48:56.820992 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 378/743] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:48:56 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:57.604423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:57.605719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:57.612791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:57.613253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:57.615489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:57.615489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:57.719646 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:57.728160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6500925e-b7cb-4ace-8c3b-53ab99b3c2d5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1210 microversion: 2.1 time: 0.127501 Jun 06 20:48:57.728744 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 366/744] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:57 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:58.096777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-48596694-7530-4add-a9a4-de2d40a0f6f0 req-cb0498d5-da15-4923-a795-968e4431c4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f732c9-6be3-4383-8911-145cfc0de38e", "tag": "ef6e2094-a459-4ff3-bf71-d276d51530f9"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:58.106521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-48596694-7530-4add-a9a4-de2d40a0f6f0 req-cb0498d5-da15-4923-a795-968e4431c4f0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:58.107263 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-48596694-7530-4add-a9a4-de2d40a0f6f0 req-cb0498d5-da15-4923-a795-968e4431c4f0 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:58.125578 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-48596694-7530-4add-a9a4-de2d40a0f6f0 req-cb0498d5-da15-4923-a795-968e4431c4f0 service nova] Creating event network-changed:ef6e2094-a459-4ff3-bf71-d276d51530f9 for instance d2f732c9-6be3-4383-8911-145cfc0de38e on hv-cinder-84487 Jun 06 20:48:58.132674 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-48596694-7530-4add-a9a4-de2d40a0f6f0 req-cb0498d5-da15-4923-a795-968e4431c4f0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040224 Jun 06 20:48:58.134681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 379/745] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:48:58.749001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:58.749706 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:58.761677 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:58.763184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:58.767489 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:58.768204 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:58.962913 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:48:58.971446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d1fe511a-3019-4db4-97ff-96a59c54c036 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.229714 Jun 06 20:48:58.972062 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 367/746] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:58 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:48:59.048122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-31418cb3-df86-45f7-9da9-7f99d944bf89 req-9359fd3f-000a-4b7e-85ab-4b3b625c154a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb", "tag": "a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:48:59.058541 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-31418cb3-df86-45f7-9da9-7f99d944bf89 req-9359fd3f-000a-4b7e-85ab-4b3b625c154a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:59.058988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-31418cb3-df86-45f7-9da9-7f99d944bf89 req-9359fd3f-000a-4b7e-85ab-4b3b625c154a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:59.071729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-31418cb3-df86-45f7-9da9-7f99d944bf89 req-9359fd3f-000a-4b7e-85ab-4b3b625c154a service nova] Creating event network-changed:a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e for instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb on hv-cinder-84487 Jun 06 20:48:59.077348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-31418cb3-df86-45f7-9da9-7f99d944bf89 req-9359fd3f-000a-4b7e-85ab-4b3b625c154a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035380 Jun 06 20:48:59.077938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 380/747] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:48:59.989362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:48:59.989996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:48:59.997142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:59.997586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:48:59.998380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:48:59.998812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:00.131321 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:00.139135 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c24890b3-f6b5-47dd-b4ca-6f5341039030 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.153517 Jun 06 20:49:00.139715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 368/748] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:48:59 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:01.156756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:01.157447 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:01.163623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:01.164097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:01.164854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:01.165287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:01.295745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:01.303544 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9fb836bb-0335-4b0f-919a-d2e2e9ca047d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.151458 Jun 06 20:49:01.304132 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 381/749] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:01 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:02.320948 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:02.321565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:02.328581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:02.343500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:02.343500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:02.343500 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:02.472497 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:02.480194 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cedb7464-a5bd-4131-87c0-0533f878ab44 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.163085 Jun 06 20:49:02.480761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 369/750] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:02 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:02.892557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:49:02.892770 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 20:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 20:49:03.323039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:03.324026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:03.330602 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.331052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.331866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.332311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.361429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4bd0b34f-11e4-4084-9f18-7d3e3d4870ab tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042325 Jun 06 20:49:03.361981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 382/751] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 20:49:03 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:03.421502 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:03.422032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:03.428542 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.428987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.429740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.430167 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.454267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:49:03.497726 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:03.497726 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:03.503427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.503915 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.504668 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.505096 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.637401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:03.645071 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-51f615e7-c08b-4017-9b34-1a6b3df9fd02 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.151962 Jun 06 20:49:03.645629 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 383/752] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:03 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:03.733190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-725eb58e-759b-4c83-879d-173fdd81334e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 204 len: 0 microversion: 2.20 time: 0.315974 Jun 06 20:49:03.733777 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 370/753] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 20:49:03 2022] DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 20:49:03.742283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:03.742903 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:03.749151 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.749533 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.750280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:03.750704 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:03.857430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:03.879361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:03.887258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:03.889058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:03.890214 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-48410939-ee65-4994-89d9-0463aa1be4b6 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.151855 Jun 06 20:49:03.890769 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 384/754] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:03 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:49:04.663199 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:04.663929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:04.670452 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:04.670901 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:04.671679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:04.672117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:04.803770 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:04.811906 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7fca761f-7f06-4e2f-a09a-d928c2c28419 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.153022 Jun 06 20:49:04.812468 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 371/755] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:04 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:04.908281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:04.908817 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:04.911403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=18 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:04.916311 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:04.916755 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:04.917540 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:04.917974 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:05.047627 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:05.055635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:05.057181 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:05.058895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0239eccf-1aaa-4a0a-be85-a642d2b0c3aa tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1723 microversion: 2.20 time: 0.154506 Jun 06 20:49:05.059446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 385/756] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:04 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:49:05.829213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:05.829823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:05.836428 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:05.836879 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:05.837652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:05.838091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:06.077853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:06.078711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:06.087033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:06.087478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:06.088284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:06.088911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:06.159754 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:06.168373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:06.170322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d3896bd70dd43fe95f7125f9f4693a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a93c20b2e4ace88184d8b156a0575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:06.171822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2ec67f0a-690f-48a9-8ab5-6e77cac857fe tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 200 len: 1656 microversion: 2.20 time: 0.098557 Jun 06 20:49:06.172806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 386/757] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:06 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:49:06.316339 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:06.326699 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-67380b14-d4c9-42de-85a2-e06656b8effc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.501114 Jun 06 20:49:06.328018 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 372/758] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:05 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:06.476982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-4486b882-d2fd-4fda-acd5-ad0dd18b83b0 req-709e4b41-5d24-4298-ba91-046ab7402acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d1b9fd-5baf-46e9-88f6-a367244145bb", "name": "network-vif-deleted", "tag": "89e69dda-ae45-4a94-bb3b-c72b9c3fa206"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:06.484992 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-4486b882-d2fd-4fda-acd5-ad0dd18b83b0 req-709e4b41-5d24-4298-ba91-046ab7402acb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:06.485427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-4486b882-d2fd-4fda-acd5-ad0dd18b83b0 req-709e4b41-5d24-4298-ba91-046ab7402acb service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:06.496700 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-4486b882-d2fd-4fda-acd5-ad0dd18b83b0 req-709e4b41-5d24-4298-ba91-046ab7402acb service nova] Creating event network-vif-deleted:89e69dda-ae45-4a94-bb3b-c72b9c3fa206 for instance 94d1b9fd-5baf-46e9-88f6-a367244145bb on hv-cinder-84487 Jun 06 20:49:06.501768 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-4486b882-d2fd-4fda-acd5-ad0dd18b83b0 req-709e4b41-5d24-4298-ba91-046ab7402acb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028521 Jun 06 20:49:06.502375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 387/759] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:07.191193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:07.191922 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:07.198767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:07.199214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:07.200018 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:07.200456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:07.214636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb HTTP/1.1 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:49:07.216454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:07.218226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '94d1b9fd-5baf-46e9-88f6-a367244145bb'} Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:07.219055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:07.220404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:07.221544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:07.221544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-913a10cd-3227-47d1-8fdb-f96a54cac21e tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 404 len: 111 microversion: 2.20 time: 0.030764 Jun 06 20:49:07.221544 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 373/760] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:07 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:49:07.227867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ccad3c68-6e86-432e-80c8-b9adf408e039 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '.version_select at 0x7fdaef4ae0d0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:07.295377 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ccad3c68-6e86-432e-80c8-b9adf408e039 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861571648" status: 204 len: 0 microversion: 2.20 time: 0.072118 Jun 06 20:49:07.296039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 388/761] 10.222.0.41 () {60 vars in 1261 bytes} [Mon Jun 6 20:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861571648 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 20:49:07.344872 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:07.345606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:07.352152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:07.352848 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:07.353821 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:07.354244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:07.374923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:07.497221 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:07.504963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b5df299e-2304-4011-9c64-6f68765c1721 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.163924 Jun 06 20:49:07.505539 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 374/762] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:07 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:08.223901 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-f9ff5c06-8a98-421f-b91a-211edb334d54 req-7fba29b0-3ec6-41cf-b79a-e3e5b388c361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb", "name": "network-vif-plugged", "status": "completed", "tag": "a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:08.235026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-f9ff5c06-8a98-421f-b91a-211edb334d54 req-7fba29b0-3ec6-41cf-b79a-e3e5b388c361 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:08.240267 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-f9ff5c06-8a98-421f-b91a-211edb334d54 req-7fba29b0-3ec6-41cf-b79a-e3e5b388c361 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:08.246287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-f9ff5c06-8a98-421f-b91a-211edb334d54 req-7fba29b0-3ec6-41cf-b79a-e3e5b388c361 service nova] Creating event network-vif-plugged:a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e for instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb on hv-cinder-84487 Jun 06 20:49:08.250989 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-f9ff5c06-8a98-421f-b91a-211edb334d54 req-7fba29b0-3ec6-41cf-b79a-e3e5b388c361 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031169 Jun 06 20:49:08.251573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 389/763] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:08.524911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:08.525462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:08.532397 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:08.532841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:08.533598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:08.534030 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:08.729371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:08.736804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0baa752d-4cd6-4b30-a4d3-30c945325ccf tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.215820 Jun 06 20:49:08.737377 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 375/764] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:08 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:09.450783 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:09.451366 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:09.457774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.458225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.459027 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.459456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.473546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb HTTP/1.1 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:49:09.475202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.477043 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '94d1b9fd-5baf-46e9-88f6-a367244145bb'} Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:09.478019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.479640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.481808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:09.481808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-338e6905-d16b-4257-a917-2b221699badc tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 404 len: 111 microversion: 2.20 time: 0.030819 Jun 06 20:49:09.481808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 390/765] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 20:49:09 2022] DELETE /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:49:09.485787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:09.486390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 94d1b9fd-5baf-46e9-88f6-a367244145bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:09.492533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.493914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.493914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.494265 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.508006 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb HTTP/1.1 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:49:09.509684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.511483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '94d1b9fd-5baf-46e9-88f6-a367244145bb'} Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:09.512927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. Jun 06 20:49:09.514822 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:09.516184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 94d1b9fd-5baf-46e9-88f6-a367244145bb could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:09.516184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-788220bf-4566-4575-bf10-86ae9a5097fb tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb" status: 404 len: 111 microversion: 2.20 time: 0.029090 Jun 06 20:49:09.516184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 376/766] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:09 2022] GET /compute/v2.1/servers/94d1b9fd-5baf-46e9-88f6-a367244145bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 20:49:09.753890 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:09.754714 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:09.762697 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.766614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.766614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:09.766614 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:09.903341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:09.911093 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-49bfe065-e304-4e75-ad19-4910e501ff06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1265 microversion: 2.1 time: 0.161295 Jun 06 20:49:09.911679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 391/767] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:09 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:10.821927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:10.822421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:10.828919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.829373 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:10.830142 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.830580 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:10.844604 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e HTTP/1.1 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:49:10.846184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.851640 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '2b0b8d95-6069-4aec-bb06-9371a5bfc63e'} Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:10.852553 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.854023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.856190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:10.856190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a1bc2275-9e85-4a78-8e6a-68ea4f7a830f tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 404 len: 111 microversion: 2.20 time: 0.029575 Jun 06 20:49:10.856190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 377/768] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 20:49:10 2022] DELETE /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:49:10.857181 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:10.857788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] [instance: 2b0b8d95-6069-4aec-bb06-9371a5bfc63e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:10.864242 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.864695 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:10.865487 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.865928 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:10.868624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=95 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:10.879758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] HTTP exception thrown: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Request method failure captured: Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e HTTP/1.1 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmat86qebaTPDFth9CGXYphzPQXQeK-07N2sAcLr-tjF9iLepNwt2myQNLN1aQq-zhw4O8AOfrl1xwM5xVAI9kmoD6QEmgYZpcM3ufR5H6itPU11VP5ysJQZQQwY03K2n5RGfq_I0ZRqz1PdYZKQBdawxaLmJEKU-6eUP35PM1zriCs Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:49:10.881261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1e2a93c20b2e4ace88184d8b156a0575"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1e2a93c20b2e4ace88184d8b156a0575", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 1e2a93c20b2e4ace88184d8b156a0575 Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-278666564 Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 3d3896bd70dd43fe95f7125f9f4693a0 Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeShelveTestJSON-278666564-project Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.885774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '2b0b8d95-6069-4aec-bb06-9371a5bfc63e'} Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:10.886681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. Jun 06 20:49:10.888170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:10.890281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] Returning 404 to user: Instance 2b0b8d95-6069-4aec-bb06-9371a5bfc63e could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:10.890281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-832ccb31-0c03-4230-8a60-a698f1dfa181 tempest-AttachVolumeShelveTestJSON-278666564 tempest-AttachVolumeShelveTestJSON-278666564-project] 10.222.0.41 "GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e" status: 404 len: 111 microversion: 2.20 time: 0.029908 Jun 06 20:49:10.890281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 392/769] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 20:49:10 2022] GET /compute/v2.1/servers/2b0b8d95-6069-4aec-bb06-9371a5bfc63e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:49:10.928073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:10.928770 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:10.936380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.936938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:10.937798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:10.938308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:11.075112 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:11.082725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3b0357c4-dcdc-4b7a-8521-73b588af330d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1453 microversion: 2.1 time: 0.158613 Jun 06 20:49:11.083296 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 378/770] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:10 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:11.099802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:11.100411 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:11.107206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:11.107682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:11.108458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:11.110648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:11.314038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:11.322227 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ad937402-becf-4ef2-aba4-900b31e64342 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1453 microversion: 2.1 time: 0.226793 Jun 06 20:49:11.322795 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 393/771] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:11 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:13.592860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-b61bcc42-0350-4cad-a32b-46ccd1a968f7 req-4f7be77e-007c-4325-a10a-aff3f5515c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb", "tag": "a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:13.597287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:13.602912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-b61bcc42-0350-4cad-a32b-46ccd1a968f7 req-4f7be77e-007c-4325-a10a-aff3f5515c24 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:13.603746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-b61bcc42-0350-4cad-a32b-46ccd1a968f7 req-4f7be77e-007c-4325-a10a-aff3f5515c24 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:13.622094 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-b61bcc42-0350-4cad-a32b-46ccd1a968f7 req-4f7be77e-007c-4325-a10a-aff3f5515c24 service nova] Creating event network-changed:a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e for instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb on hv-cinder-84487 Jun 06 20:49:13.622094 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-b61bcc42-0350-4cad-a32b-46ccd1a968f7 req-4f7be77e-007c-4325-a10a-aff3f5515c24 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033292 Jun 06 20:49:13.622784 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 379/772] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:41.977891 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:41.978502 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:41.980699 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.981372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=7 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.986182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:41.986635 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:41.987407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:41.987885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:42.011716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1ca5dabe-92d3-4687-bb36-9d3114fea64a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/ips" status: 200 len: 150 microversion: 2.1 time: 0.038074 Jun 06 20:49:42.012292 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 394/773] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:49:41 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:43.637583 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=20 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:43.642588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d49b287-288d-4278-a6ea-f89899c02da2"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:43.643761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:43.650260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:43.650707 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:43.651486 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:43.651946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:44.353827 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-11fecb73-c57b-4808-9a6c-532c5aaec7c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717679 Jun 06 20:49:44.354725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 380/774] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:49:43 2022] POST /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:50.155010 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:50.155625 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:50.161540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-a9ffb285-4589-496a-b81f-d21c41cb17cd req-276e9d24-20aa-4dbe-b130-4c4a7fa9df9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:50.171522 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:50.172292 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:50.173234 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:50.173352 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a9ffb285-4589-496a-b81f-d21c41cb17cd req-276e9d24-20aa-4dbe-b130-4c4a7fa9df9d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:50.173679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:50.173952 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-a9ffb285-4589-496a-b81f-d21c41cb17cd req-276e9d24-20aa-4dbe-b130-4c4a7fa9df9d service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:50.187332 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-a9ffb285-4589-496a-b81f-d21c41cb17cd req-276e9d24-20aa-4dbe-b130-4c4a7fa9df9d service nova] Creating event network-changed:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:49:50.193033 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-a9ffb285-4589-496a-b81f-d21c41cb17cd req-276e9d24-20aa-4dbe-b130-4c4a7fa9df9d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035841 Jun 06 20:49:50.194152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 381/775] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:50.203449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Going to try to terminate instance {{(pid=124579) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:49:50.486628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-412dfa6d-e751-4ec3-b7d1-ed1e4ecdff07 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 204 len: 0 microversion: 2.1 time: 0.335169 Jun 06 20:49:50.487432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 395/776] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:49:50 2022] DELETE /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:50.496202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:50.496908 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:50.503347 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:50.503816 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:50.504586 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:50.505020 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:50.650490 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:50.658589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-940757d8-e568-4543-a5b5-bf7340da6ca2 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.166680 Jun 06 20:49:50.659171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 382/777] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:50 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:51.857967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:51.858709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:51.865988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:51.867236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:51.868341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:51.868341 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:52.009253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:52.017426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-cad057f5-4053-4281-8246-b84dd0467779 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.342548 Jun 06 20:49:52.017992 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 396/778] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:51 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:53.035209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:53.039026 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:53.042696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:53.043145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:53.043942 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:53.044382 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:53.177752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:53.186124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-904f8bab-7ca8-462d-8455-18ec135d4d75 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.155318 Jun 06 20:49:53.186706 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 383/779] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:53 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:54.202454 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:54.203110 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:54.212993 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:54.213432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:54.214294 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:54.214866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:54.422272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:54.430077 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3cb8a777-2517-4770-bb7c-8d6984644a99 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1568 microversion: 2.1 time: 0.231420 Jun 06 20:49:54.431034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 397/780] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:54 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:54.646191 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2091f59f-112e-4924-a1bd-e45d2cb48754 req-53d515d4-5e71-4f86-8e18-3266c42b8868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a684536b-660f-47af-b824-2970df61db1d", "name": "network-vif-deleted", "tag": "410a4d73-f82f-4af6-b11a-a4ce3bfb0494"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:54.655823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2091f59f-112e-4924-a1bd-e45d2cb48754 req-53d515d4-5e71-4f86-8e18-3266c42b8868 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:54.657697 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2091f59f-112e-4924-a1bd-e45d2cb48754 req-53d515d4-5e71-4f86-8e18-3266c42b8868 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:54.668475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2091f59f-112e-4924-a1bd-e45d2cb48754 req-53d515d4-5e71-4f86-8e18-3266c42b8868 service nova] Creating event network-vif-deleted:410a4d73-f82f-4af6-b11a-a4ce3bfb0494 for instance a684536b-660f-47af-b824-2970df61db1d on hv-cinder-84487 Jun 06 20:49:54.673652 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2091f59f-112e-4924-a1bd-e45d2cb48754 req-53d515d4-5e71-4f86-8e18-3266c42b8868 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Jun 06 20:49:54.674828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 384/781] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:55.057372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-087079b7-8f74-43c7-83be-a47942985caf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: .version_select at 0x7fdaea22a3a0>, body: {"keypair": {"name": "tempest-keypair-884215802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXG/S/R64wQ9Qw+Nx7pYex82hLTG3IpNq8yBRUQiJsCKNU6n+fFwIJghBBS0kWyHspxWZIBDxie/AwGw/v+B5U20L/4n2fCro0ceLAGU+Af7xeVJFFTta8rQ361vTA78Q=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:55.073361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-087079b7-8f74-43c7-83be-a47942985caf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:49:55.077527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-087079b7-8f74-43c7-83be-a47942985caf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:49:55.225101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-087079b7-8f74-43c7-83be-a47942985caf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171986 Jun 06 20:49:55.225789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 398/782] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:49:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:49:55.448370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:55.449066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:55.455227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:55.455915 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:55.457055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:55.457168 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:55.492932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:55.493160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:55.493591 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lazy-loading 'fault' on Instance uuid a684536b-660f-47af-b824-2970df61db1d {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:49:55.539476 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13ca365980f4250820a733efe5f44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc5fd4594f2462fad03b033bbd2aa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:55.547287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b1d04fb4-f4bf-4707-9011-ad167405d6b6 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 200 len: 1224 microversion: 2.1 time: 0.103772 Jun 06 20:49:55.547910 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 385/783] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:55 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:56.567111 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:56.567679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] [instance: a684536b-660f-47af-b824-2970df61db1d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:56.574903 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:56.575515 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:56.576317 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:56.576753 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:56.591029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] HTTP exception thrown: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Request method failure captured: Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d HTTP/1.1 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmc9SfDj83m7kYcAHkAkE7nIZrj1QfvSYM8sVeBGjKn8VbLBxka1zLfyz-EQ1YcYcvQQPuM9RMtJ6BPAcJ90rPib0gPbG_7n7xtfTWza_1s2f0e9uEeQr7f_hxUDyaIL-mglFHpYsCKaVkTGOu5cIHl2clhoaxEJboxvTrIwiCvf4IA Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 3fc5fd4594f2462fad03b033bbd2aa59 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestShelveInstance-262994252 Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:49:56.592826 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3fc5fd4594f2462fad03b033bbd2aa59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3fc5fd4594f2462fad03b033bbd2aa59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3fc5fd4594f2462fad03b033bbd2aa59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3fc5fd4594f2462fad03b033bbd2aa59", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestShelveInstance-262994252 Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 3fc5fd4594f2462fad03b033bbd2aa59 Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestShelveInstance-262994252 Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestShelveInstance-262994252-project Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: b13ca365980f4250820a733efe5f44e9 Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestShelveInstance-262994252-project Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. Jun 06 20:49:56.598657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'a684536b-660f-47af-b824-2970df61db1d'} Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:49:56.599787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. Jun 06 20:49:56.601442 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:49:56.603637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Returning 404 to user: Instance a684536b-660f-47af-b824-2970df61db1d could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:49:56.603637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5f0e9fb2-6fad-4a86-9ab9-0560bf670bd8 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d" status: 404 len: 111 microversion: 2.1 time: 0.031730 Jun 06 20:49:56.603637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 399/784] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:56 2022] GET /compute/v2.1/servers/a684536b-660f-47af-b824-2970df61db1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:49:56.951178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5b7e9e54-ccbb-4783-b3eb-f18208265173 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] Calling method '.version_select at 0x7fdaea0825e0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:57.062309 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5b7e9e54-ccbb-4783-b3eb-f18208265173 tempest-TestShelveInstance-262994252 tempest-TestShelveInstance-262994252-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1131310682" status: 202 len: 0 microversion: 2.1 time: 0.114912 Jun 06 20:49:57.062975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 386/785] 10.222.0.41 () {58 vars in 1253 bytes} [Mon Jun 6 20:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1131310682 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:49:57.747207 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1823701152", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba219d3c-acea-4b6a-9365-0ffc461448ec"}], "security_groups": [{"name": "tempest-securitygroup--1883646422"}], "key_name": "tempest-keypair-884215802", "user_data": "}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:49:57.856254 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] validate_networks() for [('ba219d3c-acea-4b6a-9365-0ffc461448ec', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:49:58.254403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:49:58.254932 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:49:58.256290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:49:58.256820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:49:58.257344 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:49:58.267604 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:58.268188 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:58.269185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:58.269788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:58.301652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:49:58.306104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:49:58.318683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:49:58.321071 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:49:58.428615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8abf8c85-502d-4a98-92c1-a92113d10905 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686181 Jun 06 20:49:58.430672 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 400/786] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:49:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:49:58.447772 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-59007a79-d3dc-4e8a-a3a2-33b186d10d35 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:58.450573 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-59007a79-d3dc-4e8a-a3a2-33b186d10d35 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:58.526747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-59007a79-d3dc-4e8a-a3a2-33b186d10d35 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:58.534990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-59007a79-d3dc-4e8a-a3a2-33b186d10d35 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1241 microversion: 2.1 time: 0.097825 Jun 06 20:49:58.535971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 387/787] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:58 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:59.566316 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:49:59.566968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:49:59.575654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:59.576047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:59.576817 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:49:59.577248 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:49:59.642961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:49:59.654467 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7cb27727-b05f-496a-bd6c-9d4dcae1b041 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1245 microversion: 2.1 time: 0.105744 Jun 06 20:49:59.664520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 401/788] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:49:59 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:50:00.672172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:00.673050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:00.686657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:00.687119 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:00.687946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:00.688387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:01.048009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:01.059900 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5651edfa-aeb8-4fcc-9c12-5ee93066da91 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1301 microversion: 2.1 time: 0.391886 Jun 06 20:50:01.062946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 388/789] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:00 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1301 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:02.077865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:02.080926 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:02.087387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:02.087867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:02.088642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:02.089083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:02.225453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:02.234694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b454c216-03f5-42d7-bd45-d70ff6c26a3b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.160499 Jun 06 20:50:02.244462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 402/790] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:02 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:03.253647 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:03.254920 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:03.263501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:03.264280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:03.265316 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:03.266086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:03.424260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:03.432630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-116ec861-6581-474d-b1c1-78b3cf5272a6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.184501 Jun 06 20:50:03.433202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 389/791] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:03 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:03.893469 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-3b71bdda-c6c2-4e53-950d-6fce31e6ed61 req-8b8458b1-4217-4eab-b81c-af7a70236439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f01ee6d-2437-44c9-9fff-2325c77005a3", "tag": "483f8a83-68c5-47dd-834d-615fc4e1cb6c"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:03.903346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-3b71bdda-c6c2-4e53-950d-6fce31e6ed61 req-8b8458b1-4217-4eab-b81c-af7a70236439 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:03.904123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-3b71bdda-c6c2-4e53-950d-6fce31e6ed61 req-8b8458b1-4217-4eab-b81c-af7a70236439 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:03.917747 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-3b71bdda-c6c2-4e53-950d-6fce31e6ed61 req-8b8458b1-4217-4eab-b81c-af7a70236439 service nova] Creating event network-changed:483f8a83-68c5-47dd-834d-615fc4e1cb6c for instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 on hv-cinder-84487 Jun 06 20:50:03.923379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-3b71bdda-c6c2-4e53-950d-6fce31e6ed61 req-8b8458b1-4217-4eab-b81c-af7a70236439 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035711 Jun 06 20:50:03.924166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 403/792] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:04.451059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:04.451692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:04.459196 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:04.459645 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:04.460462 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:04.460987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:04.614446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:04.622522 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-277a52af-c692-4bc5-8d55-1170e3ef4f20 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.177613 Jun 06 20:50:04.623397 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 390/793] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:04 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:05.641851 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:05.642560 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:05.649427 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:05.650280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:05.651058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:05.651487 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:05.794261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:05.800864 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c0f3fd4c-9933-42de-a6b3-11d20ec2ec64 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.163256 Jun 06 20:50:05.801710 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 404/794] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:05 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:06.818320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:06.818832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:06.825912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:06.826387 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:06.827152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:06.827581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:06.956446 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:06.967129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1bd28b1b-378e-4bdd-9b34-6df3c9fefa0c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.152890 Jun 06 20:50:06.968008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 391/795] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:06 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:07.983793 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:07.984380 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:07.991015 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:07.991460 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:07.992263 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:07.992752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:08.126178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:08.134394 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-611276bc-0b17-4be4-a6b8-9791fd59b402 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.154324 Jun 06 20:50:08.135053 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 405/796] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:07 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:09.151125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:09.151860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:09.154533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.159581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:09.160058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:09.160863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:09.161300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:09.296542 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:09.304207 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-79276f7d-362a-4aa6-9f88-c3dfe224c41b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.156975 Jun 06 20:50:09.304771 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 392/797] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:09 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:50:09.909742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-2df2b092-21ad-49c7-b9fe-bbdcd7ac5c84 req-b7bcccf4-9c45-4330-ad9c-f95a4af3532e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f01ee6d-2437-44c9-9fff-2325c77005a3", "name": "network-vif-plugged", "status": "completed", "tag": "483f8a83-68c5-47dd-834d-615fc4e1cb6c"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:09.913256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.913919 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=10 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.920348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-2df2b092-21ad-49c7-b9fe-bbdcd7ac5c84 req-b7bcccf4-9c45-4330-ad9c-f95a4af3532e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:09.920797 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-2df2b092-21ad-49c7-b9fe-bbdcd7ac5c84 req-b7bcccf4-9c45-4330-ad9c-f95a4af3532e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:10.089535 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-2df2b092-21ad-49c7-b9fe-bbdcd7ac5c84 req-b7bcccf4-9c45-4330-ad9c-f95a4af3532e service nova] Creating event network-vif-plugged:483f8a83-68c5-47dd-834d-615fc4e1cb6c for instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 on hv-cinder-84487 Jun 06 20:50:10.094457 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-2df2b092-21ad-49c7-b9fe-bbdcd7ac5c84 req-b7bcccf4-9c45-4330-ad9c-f95a4af3532e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188516 Jun 06 20:50:10.095049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 406/798] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:10.321328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:10.323342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:10.329684 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:10.332126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:10.333082 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:10.333715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:10.505867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:10.516846 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-dc8fdd1d-cf7b-4ae4-a6f5-15de2fc6b830 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.199172 Jun 06 20:50:10.517947 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 393/799] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:10 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:11.534692 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:11.535410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:11.543253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:11.543721 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:11.544550 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:11.545016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:11.677957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:11.686243 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a4cee888-f3f8-4f15-945e-dfcf4e4e8502 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1367 microversion: 2.1 time: 0.156387 Jun 06 20:50:11.686892 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 407/800] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:11 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:12.702988 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:12.703610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:12.710378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:12.710830 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:12.711600 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:12.712681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:12.844992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:12.852732 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a0ffb9b3-eb2e-4b91-9839-034f66b907a7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1557 microversion: 2.1 time: 0.153690 Jun 06 20:50:12.853302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 394/801] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:12 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:50:12.868622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:12.869211 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:12.875981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:12.876403 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:12.877170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:12.877598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:12.957327 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7c9bc4ea-3492-4b7d-bbca-3c9aa70b1764 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092558 Jun 06 20:50:12.957980 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 408/802] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:50:12 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:13.978552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-8e0f0256-1656-487a-aa67-f77e209093de req-413c2543-c2e7-42b3-b6e2-c4d298f3c897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f01ee6d-2437-44c9-9fff-2325c77005a3", "tag": "483f8a83-68c5-47dd-834d-615fc4e1cb6c"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:13.982510 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:13.988050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8e0f0256-1656-487a-aa67-f77e209093de req-413c2543-c2e7-42b3-b6e2-c4d298f3c897 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:13.988496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8e0f0256-1656-487a-aa67-f77e209093de req-413c2543-c2e7-42b3-b6e2-c4d298f3c897 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:13.992404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:14.000073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-8e0f0256-1656-487a-aa67-f77e209093de req-413c2543-c2e7-42b3-b6e2-c4d298f3c897 service nova] Creating event network-changed:483f8a83-68c5-47dd-834d-615fc4e1cb6c for instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 on hv-cinder-84487 Jun 06 20:50:14.005320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-8e0f0256-1656-487a-aa67-f77e209093de req-413c2543-c2e7-42b3-b6e2-c4d298f3c897 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 Jun 06 20:50:14.005934 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 395/803] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:25.801065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:25.801810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:25.805632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1340949283", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "networks": [{"uuid": "52176514-4cc3-4822-8777-5ab5019f254b"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:25.856653 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] validate_networks() for [('52176514-4cc3-4822-8777-5ab5019f254b', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:50:26.202419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:50:26.202837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:50:26.203304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:50:26.203737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:50:26.204143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:50:26.213381 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:26.213858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:26.214640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:26.215066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:26.231962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Getting quotas for project 411e8573a7b94719bc65378204cbc53d. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:50:26.235848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Getting quotas for user 1b4faf2daf884d7fb15cda3bcd17c074 and project 411e8573a7b94719bc65378204cbc53d. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:50:26.246494 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:50:26.248752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:50:26.379098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b2264e72-3890-40b7-a000-82b2ec88c31e tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579356 Jun 06 20:50:26.379794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 409/804] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:50:26.391970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1a19f060-de88-4b17-b08c-f5275c2907f5 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:26.392698 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1a19f060-de88-4b17-b08c-f5275c2907f5 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:26.446644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1a19f060-de88-4b17-b08c-f5275c2907f5 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:26.453982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1a19f060-de88-4b17-b08c-f5275c2907f5 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1219 microversion: 2.1 time: 0.067350 Jun 06 20:50:26.454545 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 396/805] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:26 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:27.470632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:27.471251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:27.479472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:27.479953 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:27.480737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:27.481170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:27.544362 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:27.551974 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d9ff1763-b900-4593-8773-bc5a9d84da6c tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1223 microversion: 2.1 time: 0.085223 Jun 06 20:50:27.552547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 410/806] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:27 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:28.569881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:28.570495 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:28.578873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:28.579369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:28.580117 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:28.580739 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:28.649546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:28.657798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-200cc4f6-045c-414f-a8d6-e01e79050d90 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1277 microversion: 2.1 time: 0.092165 Jun 06 20:50:28.658369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 397/807] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:28 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:29.675805 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:29.676390 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:29.683512 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:29.683989 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:29.684756 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:29.685187 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:29.846474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:29.853813 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b8834f9e-63c5-4429-81f0-7915234a4b28 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.181996 Jun 06 20:50:29.854361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 411/808] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:29 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:30.183227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-1fb8e632-3b85-43c8-a959-0aaf1e9d381e req-1a17725a-867e-4074-933e-ae9398418380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c834b01b-11a5-4453-8dd0-2e48556197bf", "tag": "af5474d6-cff9-4b37-a90a-7c8bb1762561"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:30.191895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1fb8e632-3b85-43c8-a959-0aaf1e9d381e req-1a17725a-867e-4074-933e-ae9398418380 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:30.192692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1fb8e632-3b85-43c8-a959-0aaf1e9d381e req-1a17725a-867e-4074-933e-ae9398418380 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:30.203918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-1fb8e632-3b85-43c8-a959-0aaf1e9d381e req-1a17725a-867e-4074-933e-ae9398418380 service nova] Creating event network-changed:af5474d6-cff9-4b37-a90a-7c8bb1762561 for instance c834b01b-11a5-4453-8dd0-2e48556197bf on hv-cinder-84487 Jun 06 20:50:30.208707 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-1fb8e632-3b85-43c8-a959-0aaf1e9d381e req-1a17725a-867e-4074-933e-ae9398418380 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029465 Jun 06 20:50:30.209673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 398/809] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:50:30.871424 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:30.872062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:30.878325 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:30.878815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:30.879583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:30.880031 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:31.013474 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:31.021013 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ebaa792c-f255-49a0-a935-674ec4b170cb tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.154415 Jun 06 20:50:31.021575 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 412/810] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:30 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:32.038757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:32.039453 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:32.045803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:32.046252 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:32.047010 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:32.047443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:32.176597 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:32.184041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-612d766f-2219-4b6d-bf2e-01d518fbdde6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.149946 Jun 06 20:50:32.185243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 399/811] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:32 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:33.202669 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:33.203280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:33.209789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:33.210232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:33.210999 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:33.211432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:33.347518 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:33.355351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-be16b3cc-ac39-41c1-9855-ce3df19034b9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.156531 Jun 06 20:50:33.355967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 413/812] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:33 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:34.373082 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:34.373642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:34.380072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:34.380514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:34.381285 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:34.381713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:34.509436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:34.517193 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0b2cbc7b-e9f5-43c8-8d55-01f14f63f0ac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.148114 Jun 06 20:50:34.517756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 400/813] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:34 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:35.534837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:35.535356 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:35.541841 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:35.542281 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:35.543033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:35.543472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:35.671836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:35.679295 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-68e630cb-996d-4012-b58a-acc7525dd2ae tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.148518 Jun 06 20:50:35.679911 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 414/814] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:35 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:36.089421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-078b0a60-9760-4c6c-9b45-23bcac9021a8 req-f1c9ebfa-9ba8-472f-93c7-f4d8a52184a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c834b01b-11a5-4453-8dd0-2e48556197bf", "name": "network-vif-plugged", "status": "completed", "tag": "af5474d6-cff9-4b37-a90a-7c8bb1762561"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:36.098784 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-078b0a60-9760-4c6c-9b45-23bcac9021a8 req-f1c9ebfa-9ba8-472f-93c7-f4d8a52184a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:36.099440 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-078b0a60-9760-4c6c-9b45-23bcac9021a8 req-f1c9ebfa-9ba8-472f-93c7-f4d8a52184a8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:36.110250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-078b0a60-9760-4c6c-9b45-23bcac9021a8 req-f1c9ebfa-9ba8-472f-93c7-f4d8a52184a8 service nova] Creating event network-vif-plugged:af5474d6-cff9-4b37-a90a-7c8bb1762561 for instance c834b01b-11a5-4453-8dd0-2e48556197bf on hv-cinder-84487 Jun 06 20:50:36.115132 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-078b0a60-9760-4c6c-9b45-23bcac9021a8 req-f1c9ebfa-9ba8-472f-93c7-f4d8a52184a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029454 Jun 06 20:50:36.115738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 401/815] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:36.696554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:36.697150 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:36.699038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.700304 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.705961 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:36.706452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:36.707250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:36.707678 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:36.836722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:36.844772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8726f1cc-8b28-496d-a3fe-6d62693f3cee tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.152077 Jun 06 20:50:36.845331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 415/816] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:36 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:37.859415 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:37.863907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:37.864635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:37.870939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:37.871416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:37.872745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:37.873180 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:38.003381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:38.010854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3e83e1d6-8a71-42ac-8690-01030e597487 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1319 microversion: 2.1 time: 0.152577 Jun 06 20:50:38.011416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 402/817] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:37 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:39.028264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:39.028849 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:39.035407 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:39.035893 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:39.036665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:39.037096 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:39.165186 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:39.172671 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-be1b6bbe-63e9-4960-8a80-37916b339477 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1509 microversion: 2.1 time: 0.148268 Jun 06 20:50:39.173237 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 416/818] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:39 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:50.072937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:50.073510 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:50.075444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=17 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:50.076162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=29 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:50.081792 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.082271 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.083046 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.083482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.108801 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5a7ab908-b7a7-4e7f-a3be-371f0c57be2c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/ips" status: 200 len: 149 microversion: 2.1 time: 0.039744 Jun 06 20:50:50.109378 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 403/819] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:50:50 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:50.119803 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d49b287-288d-4278-a6ea-f89899c02da2"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:50.121036 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:50.123463 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:50.124136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=44 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:50.129430 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.129873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.130638 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.131067 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.212318 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: POST /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/os-volume_attachments HTTP/1.1 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 74 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:50:50.214047 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {"volumeAttachment": {"volumeId": "7d49b287-288d-4278-a6ea-f89899c02da2"}} Jun 06 20:50:50.215694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'server_id': '3f01ee6d-2437-44c9-9fff-2325c77005a3', 'body': {'volumeAttachment': {'volumeId': '7d49b287-288d-4278-a6ea-f89899c02da2'}}} Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:50.216657 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:50.218217 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 400 to user: Invalid volume: volume 7d49b287-288d-4278-a6ea-f89899c02da2 is already attached to instances: d2f732c9-6be3-4383-8911-145cfc0de38e {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-777684ff-623e-44d1-a38a-ab4d54da2c87 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099712 Jun 06 20:50:50.220364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 417/820] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:50:50 2022] POST /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:50:50.224790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:50.225320 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:50.236217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.236217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.236217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.236217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.260799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:50:50.525478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5b515bf7-3711-433e-a4f2-4c80b88d5c94 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 204 len: 0 microversion: 2.1 time: 0.304221 Jun 06 20:50:50.526077 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 404/821] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:50:50 2022] DELETE /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:50.534854 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:50.535466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:50.541650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.542140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.542839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:50.543278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:50.691938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:50.699466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5781c3f3-2ba0-477d-b6b3-37fc243583e1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1681 microversion: 2.1 time: 0.169082 Jun 06 20:50:50.700520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 418/822] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:50 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:51.718091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:51.718697 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:51.726101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:51.726540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:51.727303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:51.727760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:51.856783 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:51.864907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-eb3f9f39-77a0-425e-9ef3-105b5ce54cab tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1681 microversion: 2.1 time: 0.151243 Jun 06 20:50:51.865483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 405/823] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:51 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:52.882857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:52.883465 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:52.889969 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:52.890423 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:52.891200 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:52.891706 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:52.972078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:52.979988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ffdf3958-ad95-46b8-b6d2-f33c753a2746 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 200 len: 1613 microversion: 2.1 time: 0.101036 Jun 06 20:50:52.981149 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 419/824] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:52 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:53.005547 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-d42de5d6-57e3-462a-8ab1-2aa5b288a7e2 req-238e2d17-6d7e-4d23-b699-a5b980f23051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f01ee6d-2437-44c9-9fff-2325c77005a3", "name": "network-vif-deleted", "tag": "483f8a83-68c5-47dd-834d-615fc4e1cb6c"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:53.014556 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-d42de5d6-57e3-462a-8ab1-2aa5b288a7e2 req-238e2d17-6d7e-4d23-b699-a5b980f23051 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:53.014993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-d42de5d6-57e3-462a-8ab1-2aa5b288a7e2 req-238e2d17-6d7e-4d23-b699-a5b980f23051 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:53.027962 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-d42de5d6-57e3-462a-8ab1-2aa5b288a7e2 req-238e2d17-6d7e-4d23-b699-a5b980f23051 service nova] Creating event network-vif-deleted:483f8a83-68c5-47dd-834d-615fc4e1cb6c for instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 on hv-cinder-84487 Jun 06 20:50:53.033991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-d42de5d6-57e3-462a-8ab1-2aa5b288a7e2 req-238e2d17-6d7e-4d23-b699-a5b980f23051 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031954 Jun 06 20:50:53.036371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 406/825] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:53.997661 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:53.998415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:54.005475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:54.005917 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:54.006682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:54.007110 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:54.023513 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 HTTP/1.1 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:50:54.025006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:50:54.027777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '3f01ee6d-2437-44c9-9fff-2325c77005a3'} Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:50:54.029401 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:50:54.031303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:50:54.035183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:50:54.035183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3336cb6c-862a-411b-ab2b-3177d7e5423a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 404 len: 111 microversion: 2.1 time: 0.032577 Jun 06 20:50:54.035183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 420/826] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:53 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:50:54.036454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-fbfa41e7-c0e2-441a-92de-7895d25a93c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '.version_select at 0x7fdaea082e50>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:54.109341 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-fbfa41e7-c0e2-441a-92de-7895d25a93c7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884215802" status: 202 len: 0 microversion: 2.1 time: 0.077504 Jun 06 20:50:54.109921 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 407/827] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 20:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884215802 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:50:54.893684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:54.894175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:54.900236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:54.900685 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:54.901447 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:54.901883 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:54.981923 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'services' on Instance uuid d2f732c9-6be3-4383-8911-145cfc0de38e {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:50:55.198540 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8073e49f-007e-4097-88fb-9ceb35d740e6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments/7d49b287-288d-4278-a6ea-f89899c02da2" status: 202 len: 0 microversion: 2.1 time: 0.309140 Jun 06 20:50:55.199594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 421/828] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:50:54 2022] DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments/7d49b287-288d-4278-a6ea-f89899c02da2 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:50:55.208623 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:55.209598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:55.216918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:55.217364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:55.218228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:55.218662 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:55.248894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7cf0dbe2-d908-4ca5-8c16-ac521d24ad90 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Jun 06 20:50:55.249447 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 408/829] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:50:55 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:55.617820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4fa4947-8a94-45c7-818b-9b8c55b335d1", "device": "/dev/sdb"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:55.619531 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:55.625668 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:55.626111 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:55.626852 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:55.627279 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.261629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:56.262825 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:56.269894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.270377 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.271151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.271625 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.300716 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ef6ecadb-8e5d-4d87-bbdc-e10cef35b525 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043076 Jun 06 20:50:56.301277 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 409/830] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:50:56 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 20:50:56.330415 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f3c17754-f80f-413a-84af-ee83b66f4865 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "POST /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715986 Jun 06 20:50:56.331033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 422/831] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:50:55 2022] POST /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:50:56.361752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:56.362256 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:56.368248 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.369360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.369659 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.369933 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.396524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:50:56.628369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2c72f034-9f00-438c-a192-1894690ead3c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 204 len: 0 microversion: 2.1 time: 0.270757 Jun 06 20:50:56.628972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 410/832] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:50:56 2022] DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:56.638197 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:56.638919 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:56.646109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.646955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.647681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:56.648139 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:56.784759 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:56.792229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a692d187-5c96-4042-aa82-e4e1916739c8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1680 microversion: 2.1 time: 0.158569 Jun 06 20:50:56.792785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 423/833] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:56 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:57.809292 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:57.810020 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:57.817048 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:57.817494 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:57.818255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:57.818683 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:57.955750 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:57.963211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a626821b-9c22-42a4-8bdc-1a03cad995f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1680 microversion: 2.1 time: 0.158105 Jun 06 20:50:57.963789 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 411/834] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:57 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:58.980297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:50:58.980910 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:50:58.988450 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:58.988900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:58.989675 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:58.990108 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:59.066850 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:50:59.074277 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-35b181fa-2d51-46df-af00-efd955592d25 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 200 len: 1613 microversion: 2.1 time: 0.097941 Jun 06 20:50:59.075176 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 424/835] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:50:58 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:59.132727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-97d5e0d0-1b3c-47c9-a7b7-e69f9a554265 req-3be1e81b-4d3e-428d-be9d-e4368dd6f780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f732c9-6be3-4383-8911-145cfc0de38e", "name": "network-vif-deleted", "tag": "ef6e2094-a459-4ff3-bf71-d276d51530f9"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:50:59.141395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-97d5e0d0-1b3c-47c9-a7b7-e69f9a554265 req-3be1e81b-4d3e-428d-be9d-e4368dd6f780 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:50:59.142742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-97d5e0d0-1b3c-47c9-a7b7-e69f9a554265 req-3be1e81b-4d3e-428d-be9d-e4368dd6f780 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:50:59.153280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-97d5e0d0-1b3c-47c9-a7b7-e69f9a554265 req-3be1e81b-4d3e-428d-be9d-e4368dd6f780 service nova] Creating event network-vif-deleted:ef6e2094-a459-4ff3-bf71-d276d51530f9 for instance d2f732c9-6be3-4383-8911-145cfc0de38e on hv-cinder-84487 Jun 06 20:50:59.158765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-97d5e0d0-1b3c-47c9-a7b7-e69f9a554265 req-3be1e81b-4d3e-428d-be9d-e4368dd6f780 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 Jun 06 20:50:59.159380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 412/836] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:00.090553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:00.091161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:00.097944 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:00.098391 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:00.099161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:00.099641 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:00.113745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e HTTP/1.1 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:51:00.115445 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:51:00.123330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'd2f732c9-6be3-4383-8911-145cfc0de38e'} Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:51:00.124278 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:51:00.125794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:00.127839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:51:00.127839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ccb03743-3729-4a61-abad-449864ccc0c0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 404 len: 111 microversion: 2.1 time: 0.030279 Jun 06 20:51:00.127839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 425/837] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:00 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:51:00.128121 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-eea7f360-8007-4b5e-bc37-f60e6fd86da6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '.version_select at 0x7fdaea0b9310>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:00.200975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-eea7f360-8007-4b5e-bc37-f60e6fd86da6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147233555" status: 202 len: 0 microversion: 2.1 time: 0.078542 Jun 06 20:51:00.201694 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 413/838] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 20:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147233555 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:51:00.966538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-eb92dcff-8cd0-4fa0-8e73-f0e9f0b8f5c5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: .version_select at 0x7fdaea33d700>, body: {"keypair": {"name": "tempest-keypair-995805505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbqss9Bm1x4o9z4LOg9i2lVW0vnvAKiHGHfMbtiseal46SEiHghXmRMs+6JrfvMXgyrY2sRnMSvJz5WEkm6M4eaAwWAfW//6HQN9SjnvxaWDRwbnugWW3xpqEiTn2t84Q=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:00.980942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-eb92dcff-8cd0-4fa0-8e73-f0e9f0b8f5c5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:51:00.984670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-eb92dcff-8cd0-4fa0-8e73-f0e9f0b8f5c5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:51:01.057827 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-eb92dcff-8cd0-4fa0-8e73-f0e9f0b8f5c5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095139 Jun 06 20:51:01.058432 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 426/839] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:51:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:03.614234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914386993", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba219d3c-acea-4b6a-9365-0ffc461448ec"}], "security_groups": [{"name": "tempest-securitygroup--1359148201"}], "key_name": "tempest-keypair-995805505", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:03.716359 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] validate_networks() for [('ba219d3c-acea-4b6a-9365-0ffc461448ec', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:51:04.091134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:51:04.091555 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:51:04.092053 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:51:04.092461 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:51:04.092869 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:51:04.101766 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:04.102209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:04.102994 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:04.103425 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:04.120709 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:51:04.125356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:51:04.137441 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:51:04.139977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:51:04.258984 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-78707d92-1742-480f-8e97-24244ca969fd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649015 Jun 06 20:51:04.259635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 414/840] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:51:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:51:04.270438 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7ce37a01-e5bb-4fb3-80ab-d86a17db17b1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:04.271192 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7ce37a01-e5bb-4fb3-80ab-d86a17db17b1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:04.327364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-7ce37a01-e5bb-4fb3-80ab-d86a17db17b1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:04.335209 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7ce37a01-e5bb-4fb3-80ab-d86a17db17b1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1240 microversion: 2.1 time: 0.069093 Jun 06 20:51:04.335800 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 427/841] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:04 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:05.352126 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:05.352724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:05.361893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:05.362291 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:05.363066 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:05.363513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:05.426930 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:05.435125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-ffffdd5f-ebf0-4563-9523-dea80e6cf9f8 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1292 microversion: 2.1 time: 0.086909 Jun 06 20:51:05.438710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 415/842] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:05 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:06.452275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:06.452829 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:06.459329 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:06.459799 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:06.460561 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:06.460996 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:06.523875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:06.531736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e0bd866a-820c-4dd8-9439-5e40b93fd74b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1292 microversion: 2.1 time: 0.083266 Jun 06 20:51:06.532836 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 428/843] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:06 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:07.549152 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:07.549704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:07.556262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:07.556703 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:07.557456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:07.557911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:07.619531 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:07.627744 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e64c6f71-2271-4c7b-8543-29c07ac80356 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1292 microversion: 2.1 time: 0.082456 Jun 06 20:51:07.628370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 416/844] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:07 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:08.644680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:08.645289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:08.651940 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:08.652386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:08.653136 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:08.653564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:08.746454 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:08.754671 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d6a76b17-a829-4bc9-a220-681fde3cfe50 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1310 microversion: 2.1 time: 0.114422 Jun 06 20:51:08.755255 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 429/845] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:08 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1310 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:09.772179 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:09.772982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:09.779929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:09.781015 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:09.782551 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:09.783164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:09.950587 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:09.961289 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-edebca07-9e42-4430-b791-2431962e5b9b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.193676 Jun 06 20:51:09.961937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 417/846] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:09 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:10.074475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-ca26b46d-eb57-4228-8b73-f173be966851 req-d40ac105-25a2-485e-9754-77a2793a3242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9605bdb5-388f-4e9b-8c26-03cc2ba503f3", "tag": "26d9db88-6fd1-4a7f-b035-bdb713b5a005"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:10.087633 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ca26b46d-eb57-4228-8b73-f173be966851 req-d40ac105-25a2-485e-9754-77a2793a3242 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:10.088034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ca26b46d-eb57-4228-8b73-f173be966851 req-d40ac105-25a2-485e-9754-77a2793a3242 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:10.100033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-ca26b46d-eb57-4228-8b73-f173be966851 req-d40ac105-25a2-485e-9754-77a2793a3242 service nova] Creating event network-changed:26d9db88-6fd1-4a7f-b035-bdb713b5a005 for instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 on hv-cinder-84487 Jun 06 20:51:10.105160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-ca26b46d-eb57-4228-8b73-f173be966851 req-d40ac105-25a2-485e-9754-77a2793a3242 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Jun 06 20:51:10.110764 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 430/847] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:10.985850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:10.986482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:10.992945 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:10.993385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:10.994134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:10.994561 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:11.130456 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:11.138143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a490ece1-46c0-412b-b13c-43e535f6edf0 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.156327 Jun 06 20:51:11.138781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 418/848] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:10 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:12.156437 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:12.157875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:12.164171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:12.164554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:12.165312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:12.165747 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:12.291955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:12.299266 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-84935cb2-9eee-4ad0-8a28-27f970bb841c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.147910 Jun 06 20:51:12.299858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 431/849] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:12 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:13.316519 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:13.317049 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:13.323511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.323993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.327813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.327813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.414963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:13.415547 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:13.422185 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.423312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.424173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.424605 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.449683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Going to try to terminate instance {{(pid=124579) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:51:13.457932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:13.465335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-14e2d064-3496-43d5-b297-6d2f170b0248 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.153334 Jun 06 20:51:13.465888 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 419/850] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:13 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:13.724938 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c13362a8-b8c9-4447-9d6d-ebf577306a4f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 204 len: 0 microversion: 2.1 time: 0.313445 Jun 06 20:51:13.725523 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 432/851] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:51:13 2022] DELETE /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:13.733596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:13.734580 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:13.740842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.741288 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.742073 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:13.742511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:13.761518 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.884118 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:13.892534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9a3712ae-8e24-45b0-8039-f85e317eb0a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1578 microversion: 2.1 time: 0.162799 Jun 06 20:51:13.893154 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 420/852] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:13 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:14.482628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:14.483948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:14.486898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.492793 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:14.493291 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:14.494097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:14.494665 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:14.634647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:14.638554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.643601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-80a5ec2a-6de8-4dff-a04f-8a58ef7694fc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.165294 Jun 06 20:51:14.644219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 433/853] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:14 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:14.910077 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:14.910685 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:14.912733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.913380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=6 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.920681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:14.920681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:14.920681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:14.920681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:15.047524 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:15.055160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-45db4cc8-2e4c-445a-897d-8e2413f8bf22 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1578 microversion: 2.1 time: 0.149046 Jun 06 20:51:15.055741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 421/854] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:14 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:15.661065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:15.661680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:15.669319 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:15.669760 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:15.670606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:15.671094 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:15.799834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:15.807099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-154cde51-8ee0-4307-bcec-3db004e1df39 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.150443 Jun 06 20:51:15.807656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 434/855] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:15 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:16.072852 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:16.073459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:16.080693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:16.081143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:16.081907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:16.082372 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:16.215903 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:16.224360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-782e6098-7b54-4760-9aed-33784f2f18bb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1578 microversion: 2.1 time: 0.155318 Jun 06 20:51:16.224938 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 422/856] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:16 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:16.823620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:16.824243 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:16.831175 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:16.831620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:16.832398 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:16.832822 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:16.964843 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:16.972907 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8a7251b9-f266-4c5c-aab9-7e8dbb572aa6 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.153079 Jun 06 20:51:16.973472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 435/857] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:16 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:17.241432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:17.242041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:17.248505 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:17.248953 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:17.249708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:17.250137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:17.384606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:17.393442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d3b2f0ea-f721-484e-90dc-1ec7dc6fd1c2 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1578 microversion: 2.1 time: 0.155827 Jun 06 20:51:17.394367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 423/858] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:17 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:17.989810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:17.990471 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:17.996903 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:17.997348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:17.998111 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:17.998546 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:18.126688 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:18.134258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-650e575a-cb04-4b77-9bcc-92e18ccc3ac3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.148399 Jun 06 20:51:18.134830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 436/859] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:17 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:18.352409 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2d2e3c4f-a9e8-4f37-ab06-f3bf636de4fe req-f543fe05-1619-47eb-840e-25a5b9ecff70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9605bdb5-388f-4e9b-8c26-03cc2ba503f3", "name": "network-vif-plugged", "status": "completed", "tag": "26d9db88-6fd1-4a7f-b035-bdb713b5a005"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:18.365262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2d2e3c4f-a9e8-4f37-ab06-f3bf636de4fe req-f543fe05-1619-47eb-840e-25a5b9ecff70 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:18.365751 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2d2e3c4f-a9e8-4f37-ab06-f3bf636de4fe req-f543fe05-1619-47eb-840e-25a5b9ecff70 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:18.379955 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2d2e3c4f-a9e8-4f37-ab06-f3bf636de4fe req-f543fe05-1619-47eb-840e-25a5b9ecff70 service nova] Creating event network-vif-plugged:26d9db88-6fd1-4a7f-b035-bdb713b5a005 for instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 on hv-cinder-84487 Jun 06 20:51:18.386940 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2d2e3c4f-a9e8-4f37-ab06-f3bf636de4fe req-f543fe05-1619-47eb-840e-25a5b9ecff70 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Jun 06 20:51:18.388137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 424/860] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:18.410892 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:18.411565 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:18.422404 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:18.422982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:18.424095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:18.424606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:18.732475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:18.745862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a5b677c3-a1c4-4e79-99b3-5363c6791505 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1578 microversion: 2.1 time: 0.339070 Jun 06 20:51:18.748452 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 437/861] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:18 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1578 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:19.154267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:19.154909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:19.162629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:19.167008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:19.167008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:19.167008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:19.308727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:19.321529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-57a08505-cef5-4534-a004-675c02a35590 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.172483 Jun 06 20:51:19.322322 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 425/862] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:19 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:19.433084 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-cdd1abdb-f45d-4029-8ca7-ef93025c1c03 req-5b59c100-4922-4478-b86f-6b0923b4922e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb", "name": "network-vif-deleted", "tag": "a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:19.441872 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-cdd1abdb-f45d-4029-8ca7-ef93025c1c03 req-5b59c100-4922-4478-b86f-6b0923b4922e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:19.442209 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-cdd1abdb-f45d-4029-8ca7-ef93025c1c03 req-5b59c100-4922-4478-b86f-6b0923b4922e service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:19.453825 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-cdd1abdb-f45d-4029-8ca7-ef93025c1c03 req-5b59c100-4922-4478-b86f-6b0923b4922e service nova] Creating event network-vif-deleted:a4b8a9ae-6c18-4ca9-8de0-f70ab2a54f9e for instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb on hv-cinder-84487 Jun 06 20:51:19.458833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-cdd1abdb-f45d-4029-8ca7-ef93025c1c03 req-5b59c100-4922-4478-b86f-6b0923b4922e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029426 Jun 06 20:51:19.459429 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 438/863] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:51:19.764530 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:19.765133 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:19.773786 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:19.774600 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:19.775380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:19.775850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:19.848557 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:19.860314 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-989eeb9f-81e5-4107-8c1e-0299084135bc tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1225 microversion: 2.1 time: 0.099314 Jun 06 20:51:19.862455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 426/864] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:19 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:20.339018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:20.340039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:20.342240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.348233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:20.348676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:20.349482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:20.349992 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:20.489037 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:20.496670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9818f68e-0c3d-459c-bb0e-aa8421abe754 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1366 microversion: 2.1 time: 0.161977 Jun 06 20:51:20.497240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 439/865] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:20 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:20.882992 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:20.884230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:20.886870 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.893303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:20.893303 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:20.894027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:20.894459 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:20.926287 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:20.926776 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:20.927231 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lazy-loading 'fault' on Instance uuid 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:51:20.967515 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:20.975025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b3691904-fc33-44b4-888c-8644eac83e14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 200 len: 1230 microversion: 2.1 time: 0.096279 Jun 06 20:51:20.975581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 427/866] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:20 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:21.515526 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:21.516126 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:21.522839 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:21.523290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:21.524083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:21.524521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:21.653109 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:21.661141 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8823d558-e1c1-4cf2-97ef-bf844729142d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1556 microversion: 2.1 time: 0.150134 Jun 06 20:51:21.661710 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 440/867] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:21 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:21.677793 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:21.678289 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:21.684819 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:21.685262 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:21.686025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:21.686451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:21.769576 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-74ec5770-4f0f-47df-b983-e4a532c01397 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095662 Jun 06 20:51:21.770189 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 428/868] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:51:21 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:21.991989 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:21.992601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:21.998859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:21.999406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.000245 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.001476 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.015574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] HTTP exception thrown: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Request method failure captured: Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb HTTP/1.1 Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgWYa1J--8G6UrFYkTGYfqUoqHDuWHwQA_A59Q1ZQFpyntAiF6coc16dgON5yKP0pLEnX_fxNCw-J-VRE1Npeh4NKGSvT-ExpUkmL57tJfv8Py-OUoCURoogqBMImkxKG-aViclyL4mVAA96JTp4z9byl1Jd6pEZTAFw1wA_ruoAqA Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:51:22.017782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c1ea53cfd795419cacebe7f2d071f37f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestVolumeBootPattern-20911414 Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 2bb3e3fc9a494cdf8abd264038af044c Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:51:22.019538 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb'} Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:51:22.020613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:51:22.022206 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:22.023634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Returning 404 to user: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:51:22.023634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1852864e-35b2-4c6e-84b0-5bb7a6122740 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 404 len: 111 microversion: 2.1 time: 0.030981 Jun 06 20:51:22.027387 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 441/869] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:21 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:51:22.102679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:22.103325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:22.110279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.110853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.111774 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.112308 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.134597 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1609049250", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1910891760", "security_groups": [{"name": "tempest-secgroup-smoke-561185832"}], "block_device_mapping_v2": [{"uuid": "d03e7fdf-dcb6-4394-b8d9-1d2f54c56833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b263e80-04f0-46e3-a24e-eb32fd6a6da0"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:22.203149 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lazy-loading 'services' on Instance uuid c834b01b-11a5-4453-8dd0-2e48556197bf {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:51:22.276659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] validate_networks() for [('8b263e80-04f0-46e3-a24e-eb32fd6a6da0', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:51:22.456425 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9276ff00-f14c-43ab-9dc7-8ddcb3e3b095 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf/os-volume_attachments/d4fa4947-8a94-45c7-818b-9b8c55b335d1" status: 202 len: 0 microversion: 2.1 time: 0.360655 Jun 06 20:51:22.457285 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 429/870] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:51:22 2022] DELETE /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf/os-volume_attachments/d4fa4947-8a94-45c7-818b-9b8c55b335d1 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:51:22.667406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:51:22.667867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:51:22.668352 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:51:22.668764 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:51:22.669195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:51:22.678521 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.678968 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.679794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.680232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.697693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:51:22.701722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for user 2bb3e3fc9a494cdf8abd264038af044c and project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:51:22.761450 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:51:22.764039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d03e7fdf-dcb6-4394-b8d9-1d2f54c56833',volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:51:22.792246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-0e22c800-2fe7-441c-8467-7d20f76e576c req-c84df8d1-d448-469c-a6c8-d8c158bad7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9605bdb5-388f-4e9b-8c26-03cc2ba503f3", "tag": "26d9db88-6fd1-4a7f-b035-bdb713b5a005"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:22.803302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-0e22c800-2fe7-441c-8467-7d20f76e576c req-c84df8d1-d448-469c-a6c8-d8c158bad7fe service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:22.804169 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-0e22c800-2fe7-441c-8467-7d20f76e576c req-c84df8d1-d448-469c-a6c8-d8c158bad7fe service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:22.820815 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-0e22c800-2fe7-441c-8467-7d20f76e576c req-c84df8d1-d448-469c-a6c8-d8c158bad7fe service nova] Creating event network-changed:26d9db88-6fd1-4a7f-b035-bdb713b5a005 for instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 on hv-cinder-84487 Jun 06 20:51:22.821055 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-0e22c800-2fe7-441c-8467-7d20f76e576c req-c84df8d1-d448-469c-a6c8-d8c158bad7fe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033356 Jun 06 20:51:22.821729 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 430/871] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:51:23.265128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3654b466-a61b-414c-9651-5e25b5e4c6af tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.141445 Jun 06 20:51:23.268677 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 442/872] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:51:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:51:23.278686 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b75620b0-16c5-439f-a5d3-fe5031f08768 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:23.279389 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b75620b0-16c5-439f-a5d3-fe5031f08768 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:23.360610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b75620b0-16c5-439f-a5d3-fe5031f08768 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:23.368434 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b75620b0-16c5-439f-a5d3-fe5031f08768 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1095 microversion: 2.1 time: 0.094421 Jun 06 20:51:23.369575 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 431/873] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:23 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:23.593059 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:23.593606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:23.600620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:23.601221 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:23.602095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:23.602915 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:23.629331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Going to try to terminate instance {{(pid=124579) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:51:23.999115 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-7881ec0f-8417-4961-ab8b-55eedd6de42d tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 204 len: 0 microversion: 2.1 time: 0.410252 Jun 06 20:51:23.999997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 443/874] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:51:23 2022] DELETE /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:24.010212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:24.010986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:24.019529 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:24.020108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:24.021063 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:24.021589 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:24.160584 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:24.168304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b496343f-2300-4a7b-9c12-6dbb0b90b4a6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1515 microversion: 2.1 time: 0.162577 Jun 06 20:51:24.168894 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 432/875] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:24 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:24.386615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:24.387562 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:24.394122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:24.394562 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:24.395328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:24.395801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:24.468268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:24.476372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ee79cfbd-d806-460e-bd15-2c42092ebcc4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1145 microversion: 2.1 time: 0.094059 Jun 06 20:51:24.476926 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 444/876] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:24 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:25.185351 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:25.185951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:25.192868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:25.193559 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:25.194333 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:25.194762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:25.332244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:25.339864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1307a7c8-abf7-4209-9f8c-2678d34c31b2 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1515 microversion: 2.1 time: 0.158383 Jun 06 20:51:25.340431 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 433/877] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:25 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:25.494448 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:25.495405 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:25.503925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:25.504373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:25.505350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:25.506020 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:25.613596 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:25.622483 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b463afe5-a9fe-4ffb-a52f-83291e761599 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1137 microversion: 2.1 time: 0.132108 Jun 06 20:51:25.631646 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 445/878] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:25 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1137 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:26.057253 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2a78cfbc-220e-46c5-9a73-a5a8b2e550ab req-769f5f6e-3b15-4e19-8d37-2eb978acc537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c834b01b-11a5-4453-8dd0-2e48556197bf", "name": "network-vif-deleted", "tag": "af5474d6-cff9-4b37-a90a-7c8bb1762561"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:26.066748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2a78cfbc-220e-46c5-9a73-a5a8b2e550ab req-769f5f6e-3b15-4e19-8d37-2eb978acc537 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.067184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2a78cfbc-220e-46c5-9a73-a5a8b2e550ab req-769f5f6e-3b15-4e19-8d37-2eb978acc537 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.079183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2a78cfbc-220e-46c5-9a73-a5a8b2e550ab req-769f5f6e-3b15-4e19-8d37-2eb978acc537 service nova] Creating event network-vif-deleted:af5474d6-cff9-4b37-a90a-7c8bb1762561 for instance c834b01b-11a5-4453-8dd0-2e48556197bf on hv-cinder-84487 Jun 06 20:51:26.084855 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2a78cfbc-220e-46c5-9a73-a5a8b2e550ab req-769f5f6e-3b15-4e19-8d37-2eb978acc537 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031908 Jun 06 20:51:26.085543 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 434/879] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:26.359004 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:26.359786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:26.367255 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.368075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.369906 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.370741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.405256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.405702 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.406154 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lazy-loading 'fault' on Instance uuid c834b01b-11a5-4453-8dd0-2e48556197bf {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:51:26.470241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:26.478414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-67c1d806-a516-4380-baa6-2b043dc969c7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 200 len: 1309 microversion: 2.1 time: 0.125026 Jun 06 20:51:26.478994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 446/880] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:26 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:26.641670 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:26.642377 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:26.648690 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.649145 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.649918 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:26.650356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:26.717423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:26.740273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f73c3ec1-24c9-4d5d-b37c-8d7b1203552d tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1211 microversion: 2.1 time: 0.100727 Jun 06 20:51:26.747564 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 435/881] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:26 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:27.500139 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:27.506658 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: c834b01b-11a5-4453-8dd0-2e48556197bf] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:27.513446 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:27.514255 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:27.515929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:27.517085 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:27.543729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] HTTP exception thrown: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Request method failure captured: Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf HTTP/1.1 Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmiP7K7_zNMmOv5_lawzs8CBgZ7U4HWrOOH-VhipGdt4UcllEIdEittJM1YmwT11jB1TK5oe9r--cLAGJ7X19I1zPGhcwle51gAGqAwRlOjUP9J77V_qBfdpVVQp_tbJv9_Z93sXwtmxRJPBzAuZOGHdEU_jBs-zLiP2KpRnXXFB6WA Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 411e8573a7b94719bc65378204cbc53d Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:51:27.546957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_411e8573a7b94719bc65378204cbc53d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 411e8573a7b94719bc65378204cbc53d Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesSnapshotTestJSON-1231069048-project Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 1b4faf2daf884d7fb15cda3bcd17c074 Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesSnapshotTestJSON-1231069048-project Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. Jun 06 20:51:27.548648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'c834b01b-11a5-4453-8dd0-2e48556197bf'} Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:51:27.550092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. Jun 06 20:51:27.551616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:51:27.553239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Returning 404 to user: Instance c834b01b-11a5-4453-8dd0-2e48556197bf could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:51:27.553239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9562b51c-0eca-47f2-a13b-b40fca8a3d69 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf" status: 404 len: 111 microversion: 2.1 time: 0.056574 Jun 06 20:51:27.553239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 447/882] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:27 2022] GET /compute/v2.1/servers/c834b01b-11a5-4453-8dd0-2e48556197bf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:51:27.755059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:27.755804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:27.763134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:27.765520 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:27.766761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:27.767427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:27.901761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:27.910856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7e5bcac2-f38f-4b01-b48a-a7ab6e530359 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1278 microversion: 2.1 time: 0.160362 Jun 06 20:51:27.912706 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 436/883] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:27 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:51:28.441490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-86d73da0-1d6e-468d-a2d0-9aa28d490135 req-4b586467-cecc-4dcb-84d9-5d9b05cb50d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccb3806-679a-4d48-8e91-9dc2037a15dd", "tag": "a2362686-dc53-476f-8337-3b482cdeed2a"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:28.451815 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-86d73da0-1d6e-468d-a2d0-9aa28d490135 req-4b586467-cecc-4dcb-84d9-5d9b05cb50d6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:28.452620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-86d73da0-1d6e-468d-a2d0-9aa28d490135 req-4b586467-cecc-4dcb-84d9-5d9b05cb50d6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:28.464847 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-86d73da0-1d6e-468d-a2d0-9aa28d490135 req-4b586467-cecc-4dcb-84d9-5d9b05cb50d6 service nova] Creating event network-changed:a2362686-dc53-476f-8337-3b482cdeed2a for instance fccb3806-679a-4d48-8e91-9dc2037a15dd on hv-cinder-84487 Jun 06 20:51:28.470283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-86d73da0-1d6e-468d-a2d0-9aa28d490135 req-4b586467-cecc-4dcb-84d9-5d9b05cb50d6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033073 Jun 06 20:51:28.471529 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 448/884] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:28.928286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:28.928840 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:28.935418 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:28.935907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:28.936673 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:28.937123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:29.072035 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:29.079914 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-52b7e9c3-521f-42ca-98bc-2079ccbd2a7b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.155536 Jun 06 20:51:29.080523 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 437/885] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:28 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:30.098453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:30.099287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:30.105624 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:30.106070 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:30.106859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:30.107291 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:30.248806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:30.257216 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e264d44b-9c5a-45f5-b757-c0750c244f36 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.163479 Jun 06 20:51:30.257715 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 449/886] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:30 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:31.275302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:31.275944 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:31.283305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:31.283806 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:31.284971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:31.285416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:31.421252 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:31.429036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3fe22779-a0b8-4f45-93aa-4bfd660bd941 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.157920 Jun 06 20:51:31.429607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 438/887] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:31 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:32.447323 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:32.447982 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:32.454835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:32.455284 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:32.456134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:32.456579 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:32.598355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:32.606373 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c2c4cf95-70d8-49ca-86f9-9f19882a8ec5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.163346 Jun 06 20:51:32.606981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 450/888] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:32 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:33.623850 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:33.624455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:33.626873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.632284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:33.632738 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:33.633506 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:33.633946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:33.652745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.762304 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:33.770235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-86e59658-e6f3-4bb5-81b2-78b10b24eaec tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.150315 Jun 06 20:51:33.770800 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 439/889] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:33 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:34.787423 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:34.788052 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:34.790177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.791003 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.796343 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:34.796917 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:34.797676 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:34.798154 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:34.928038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:34.931435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.935774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-10eba039-d915-4fde-8f46-e9f40cb855fb tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.152796 Jun 06 20:51:34.936337 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 451/890] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:34 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:35.952925 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:35.953540 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:35.960129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:35.960578 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:35.961340 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:35.961782 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:36.094482 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1699345304", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "networks": [{"uuid": "52176514-4cc3-4822-8777-5ab5019f254b"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:36.102141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:36.109581 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cdc6ec78-8761-439e-b67d-85fa2b35296b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.160605 Jun 06 20:51:36.110140 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 440/891] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:35 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:36.146601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] validate_networks() for [('52176514-4cc3-4822-8777-5ab5019f254b', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:51:36.482173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:51:36.482616 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:51:36.483086 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:51:36.483491 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:51:36.483925 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:51:36.492680 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:36.493119 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:36.493942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:36.494365 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:36.511016 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Getting quotas for project 411e8573a7b94719bc65378204cbc53d. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:51:36.515166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Getting quotas for user 1b4faf2daf884d7fb15cda3bcd17c074 and project 411e8573a7b94719bc65378204cbc53d. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:51:36.526626 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:51:36.528886 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:51:36.685095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f9b250af-e4cf-42c9-8496-a388ec10eed7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594414 Jun 06 20:51:36.685745 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 452/892] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 20:51:36.696017 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2c498c4a-df6f-4b2e-bc2d-6576db660bb1 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:36.696632 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2c498c4a-df6f-4b2e-bc2d-6576db660bb1 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:36.748269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2c498c4a-df6f-4b2e-bc2d-6576db660bb1 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:36.755432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2c498c4a-df6f-4b2e-bc2d-6576db660bb1 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1219 microversion: 2.1 time: 0.063226 Jun 06 20:51:36.756026 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 441/893] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:36 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:37.127088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:37.128505 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:37.135489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:37.135705 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:37.136376 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:37.137072 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:37.271948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:37.279389 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c2aec658-4251-48c8-b784-ba8da193f3a8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.156905 Jun 06 20:51:37.279986 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 453/894] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:37 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:37.773197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:37.773832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:37.780275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:37.780732 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:37.781496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:37.781932 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:37.842197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:37.850572 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-731714b7-faf7-46e6-81e6-20ae464da140 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1223 microversion: 2.1 time: 0.081812 Jun 06 20:51:37.852781 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 442/895] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:37 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:38.296729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:38.299361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:38.303840 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:38.304283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:38.305044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:38.305472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:38.442083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:38.450102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-51564c6d-dab8-4fe7-97ea-56e2a46915c8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.157250 Jun 06 20:51:38.450873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 454/896] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:38 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:38.869829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:38.869829 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:38.876449 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:38.876903 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:38.878390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:38.878847 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:38.946005 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:38.953585 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5767533f-2c7a-4a7e-b29d-6053883c075f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1277 microversion: 2.1 time: 0.089833 Jun 06 20:51:38.954159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 443/897] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:38 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:39.468734 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:39.469307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:39.476554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:39.476997 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:39.477802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:39.478229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:39.893275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:39.901173 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d5db8d24-3b21-4c2c-961e-63c27961188b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.436698 Jun 06 20:51:39.901729 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 455/898] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:39 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:39.970269 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:39.970881 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:39.977977 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:39.978427 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:39.979197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:39.979721 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:40.108982 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:40.116726 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6dece099-12f5-492f-9e6c-5aac84cbd232 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.150351 Jun 06 20:51:40.117299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 444/899] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:39 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:40.422262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-ce075e97-9d38-4f39-8782-bf8bca37dc25 req-2890e54b-b6d9-415b-9fc2-e06968eae363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187a494b-61bd-4344-97b1-4779c9875146", "tag": "65bc07d4-97bd-4848-88f2-3be41e8f2ad1"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:40.430909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ce075e97-9d38-4f39-8782-bf8bca37dc25 req-2890e54b-b6d9-415b-9fc2-e06968eae363 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:40.430909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ce075e97-9d38-4f39-8782-bf8bca37dc25 req-2890e54b-b6d9-415b-9fc2-e06968eae363 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:40.442711 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-ce075e97-9d38-4f39-8782-bf8bca37dc25 req-2890e54b-b6d9-415b-9fc2-e06968eae363 service nova] Creating event network-changed:65bc07d4-97bd-4848-88f2-3be41e8f2ad1 for instance 187a494b-61bd-4344-97b1-4779c9875146 on hv-cinder-84487 Jun 06 20:51:40.447489 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-ce075e97-9d38-4f39-8782-bf8bca37dc25 req-2890e54b-b6d9-415b-9fc2-e06968eae363 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035440 Jun 06 20:51:40.448479 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 456/900] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:40.918178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:40.918853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:40.925430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:40.925875 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:40.926620 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:40.927050 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:41.063227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:41.070818 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a5d52d4b-f97d-46f3-8a7e-9387adad05c5 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.156377 Jun 06 20:51:41.071504 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 445/901] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:40 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:41.134048 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:41.134785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:41.141636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:41.142079 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:41.142828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:41.143259 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:41.279634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:41.287620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dcff8d44-df1a-4627-9c87-24e9643d62c0 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.158341 Jun 06 20:51:41.288213 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 457/902] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:41 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:42.087761 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:42.088374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:42.094787 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:42.095233 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:42.096009 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:42.096442 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:42.225395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:42.232882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a215942e-e7b0-465d-a796-f99f42c26712 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.148964 Jun 06 20:51:42.233445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 446/903] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:42 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:42.304643 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:42.305245 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:42.311613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:42.312086 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:42.312835 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:42.313270 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:42.444830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:42.452307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4f2571de-64b6-4c0e-93de-abe7ebbdae0b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.151918 Jun 06 20:51:42.452882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 458/904] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:42 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:51:42.463024 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-2f72f6d6-e3c3-4ecb-aa84-a6bd298d75ac req-1d71cb62-aa3e-4dd9-b76a-68a310f5012a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb3806-679a-4d48-8e91-9dc2037a15dd", "name": "network-vif-plugged", "status": "completed", "tag": "a2362686-dc53-476f-8337-3b482cdeed2a"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:42.471374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2f72f6d6-e3c3-4ecb-aa84-a6bd298d75ac req-1d71cb62-aa3e-4dd9-b76a-68a310f5012a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:42.471859 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-2f72f6d6-e3c3-4ecb-aa84-a6bd298d75ac req-1d71cb62-aa3e-4dd9-b76a-68a310f5012a service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:42.483146 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-2f72f6d6-e3c3-4ecb-aa84-a6bd298d75ac req-1d71cb62-aa3e-4dd9-b76a-68a310f5012a service nova] Creating event network-vif-plugged:a2362686-dc53-476f-8337-3b482cdeed2a for instance fccb3806-679a-4d48-8e91-9dc2037a15dd on hv-cinder-84487 Jun 06 20:51:42.488740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-2f72f6d6-e3c3-4ecb-aa84-a6bd298d75ac req-1d71cb62-aa3e-4dd9-b76a-68a310f5012a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028800 Jun 06 20:51:42.489325 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 447/905] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:43.249301 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:43.249909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:43.256065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:43.256510 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:43.257268 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:43.257703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:43.386618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:43.394249 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a34350f8-2c49-4247-a247-45c0320a7de9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1266 microversion: 2.1 time: 0.148839 Jun 06 20:51:43.394807 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 459/906] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:43 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:43.470381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:43.471084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:43.477882 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:43.478327 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:43.479081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:43.479514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:43.605698 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:43.613093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7bc43164-0426-424d-92f3-57b43d645aac tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.147379 Jun 06 20:51:43.613660 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 448/907] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:43 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:44.410235 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:44.411484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:44.417963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.418406 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.419166 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.419598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.551419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:44.559078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-678e8521-0c73-445b-8adb-ca662f401e84 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1453 microversion: 2.1 time: 0.152662 Jun 06 20:51:44.559875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 460/908] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:44 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:44.574980 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:44.575691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:44.582713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.583160 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.583939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.584395 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.630574 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:44.631303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:44.637649 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.638097 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.638857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:44.639291 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:44.719227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:44.726998 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e5922b75-90a2-4676-a81c-5e8804645f80 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1453 microversion: 2.1 time: 0.155894 Jun 06 20:51:44.727762 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 449/909] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:44 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:44.777151 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:44.788083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fc616c83-01c4-4e49-bfa6-fe63ea0f70af tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.161824 Jun 06 20:51:44.789068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 461/910] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:44 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:51:45.805190 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:45.805800 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:45.812606 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:45.813047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:45.813873 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:45.814306 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:46.029444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:46.037628 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-36319d28-b2c1-40d3-a3e9-34c34d34cab7 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.236368 Jun 06 20:51:46.038204 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 450/911] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:45 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:46.534084 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-048c7fd4-a297-41f9-a318-44f6d2eb2d6c req-0ce9c61c-1048-410e-b6b0-a847efae1326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a494b-61bd-4344-97b1-4779c9875146", "name": "network-vif-plugged", "status": "completed", "tag": "65bc07d4-97bd-4848-88f2-3be41e8f2ad1"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:46.540158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.540963 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.544988 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-048c7fd4-a297-41f9-a318-44f6d2eb2d6c req-0ce9c61c-1048-410e-b6b0-a847efae1326 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:46.548998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-048c7fd4-a297-41f9-a318-44f6d2eb2d6c req-0ce9c61c-1048-410e-b6b0-a847efae1326 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:46.556876 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-048c7fd4-a297-41f9-a318-44f6d2eb2d6c req-0ce9c61c-1048-410e-b6b0-a847efae1326 service nova] Creating event network-vif-plugged:65bc07d4-97bd-4848-88f2-3be41e8f2ad1 for instance 187a494b-61bd-4344-97b1-4779c9875146 on hv-cinder-84487 Jun 06 20:51:46.561985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-048c7fd4-a297-41f9-a318-44f6d2eb2d6c req-0ce9c61c-1048-410e-b6b0-a847efae1326 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Jun 06 20:51:46.563233 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 462/912] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:46.934412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-cf2846ab-66dc-41b9-96f7-48a39afb2d37 req-4dd2e73c-7b90-4846-8495-1fa10a476049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccb3806-679a-4d48-8e91-9dc2037a15dd", "tag": "a2362686-dc53-476f-8337-3b482cdeed2a"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:46.938237 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.944379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-cf2846ab-66dc-41b9-96f7-48a39afb2d37 req-4dd2e73c-7b90-4846-8495-1fa10a476049 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:46.944854 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-cf2846ab-66dc-41b9-96f7-48a39afb2d37 req-4dd2e73c-7b90-4846-8495-1fa10a476049 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:46.955722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-cf2846ab-66dc-41b9-96f7-48a39afb2d37 req-4dd2e73c-7b90-4846-8495-1fa10a476049 service nova] Creating event network-changed:a2362686-dc53-476f-8337-3b482cdeed2a for instance fccb3806-679a-4d48-8e91-9dc2037a15dd on hv-cinder-84487 Jun 06 20:51:46.961360 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-cf2846ab-66dc-41b9-96f7-48a39afb2d37 req-4dd2e73c-7b90-4846-8495-1fa10a476049 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030830 Jun 06 20:51:46.961950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 451/913] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:47.055642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:47.056423 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:47.063234 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:47.063798 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:47.064563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:47.065029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:47.280910 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:47.288819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-55651236-8f3c-41f7-8067-fe6588982c64 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1319 microversion: 2.1 time: 0.238181 Jun 06 20:51:47.289609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 463/914] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:47 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:48.307358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:48.308423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:48.314963 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:48.315419 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:48.316217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:48.316655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:48.451224 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:51:48.459629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5604541b-5a4f-4d9f-9d3b-b8f0a5009df9 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1509 microversion: 2.1 time: 0.157581 Jun 06 20:51:48.460215 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 452/915] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:51:48 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:48.476748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e260aab-ebb8-4c63-b226-97c4e402e92a", "device": "/dev/sdb"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:51:48.477842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:48.484492 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:48.484873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:48.485632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:48.486065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:49.350652 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1f59a345-e32d-44fd-8ce3-034409d99b3f tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "POST /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877728 Jun 06 20:51:49.351204 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 464/916] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:51:48 2022] POST /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:51:59.127040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:51:59.127588 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:51:59.130393 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=57 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:59.131636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=66 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:59.136731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:59.137184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:59.137961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:51:59.138393 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:51:59.162025 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e4673c4e-ea47-40f4-969f-107f4feeb5cc tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.038871 Jun 06 20:51:59.162599 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 453/917] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:51:59 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:52:00.701802 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.702586 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.706736 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a1af841-e61f-465e-ba43-ee0f2fc05977"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:00.707948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:00.714570 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:00.715007 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:00.715788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:00.716225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:01.476717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6050149c-f6ca-45dc-8c5c-ea7d3cbe97d7 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776140 Jun 06 20:52:01.477330 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 465/918] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:52:00 2022] POST /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:52:09.267084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:09.270223 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:09.274986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:09.275436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:09.276234 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:09.276669 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:09.465214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lazy-loading 'services' on Instance uuid 187a494b-61bd-4344-97b1-4779c9875146 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:52:09.643390 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f5ea144a-f7f5-42cf-b106-3c7b63a3eac4 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "DELETE /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146/os-volume_attachments/5e260aab-ebb8-4c63-b226-97c4e402e92a" status: 202 len: 0 microversion: 2.1 time: 0.380588 Jun 06 20:52:09.644037 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 454/919] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:52:09 2022] DELETE /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146/os-volume_attachments/5e260aab-ebb8-4c63-b226-97c4e402e92a => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:52:12.131830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:12.133682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:12.138312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a1af841-e61f-465e-ba43-ee0f2fc05977"}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:12.141779 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:12.145670 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.146120 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.146882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.147320 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.280866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: POST /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments HTTP/1.1 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 74 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:52:12.282648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {"volumeAttachment": {"volumeId": "4a1af841-e61f-465e-ba43-ee0f2fc05977"}} Jun 06 20:52:12.284419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'server_id': '9605bdb5-388f-4e9b-8c26-03cc2ba503f3', 'body': {'volumeAttachment': {'volumeId': '4a1af841-e61f-465e-ba43-ee0f2fc05977'}}} Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:12.285283 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:12.286722 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 400 to user: Invalid volume: volume 4a1af841-e61f-465e-ba43-ee0f2fc05977 is already attached to instances: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-29546a94-53c7-43ec-8be9-92fab8ea0c5d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153969 Jun 06 20:52:12.288049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 466/920] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:52:12 2022] POST /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:52:12.345201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:12.348078 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:12.352549 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.353004 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.353757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.354197 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.433381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'services' on Instance uuid 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:52:12.637375 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1495a212-2c89-43db-b887-79f054c3bfbd tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments/4a1af841-e61f-465e-ba43-ee0f2fc05977" status: 202 len: 0 microversion: 2.1 time: 0.296891 Jun 06 20:52:12.638207 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 455/921] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:52:12 2022] DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments/4a1af841-e61f-465e-ba43-ee0f2fc05977 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 20:52:12.646873 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:12.651078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:12.654698 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.655146 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.655941 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.656379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.685623 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-fa4677f9-134f-49d0-8526-525b0edba2f9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Jun 06 20:52:12.686261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 467/922] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:52:12 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:12.859444 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:12.860294 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:12.866416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.866866 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.867621 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:12.868075 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:12.892229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:52:13.169528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8f03adc2-8531-457a-af3f-f69c56fe9083 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "DELETE /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 204 len: 0 microversion: 2.1 time: 0.314027 Jun 06 20:52:13.170046 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 456/923] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:52:12 2022] DELETE /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:52:13.178276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:13.178994 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:13.185453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:13.185900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:13.186664 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:13.187095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:13.324061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:13.331461 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ac0bd0b9-e07f-44a2-85e2-28c7db037199 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1515 microversion: 2.1 time: 0.157000 Jun 06 20:52:13.332031 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 468/924] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:13 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:13.698618 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:13.699734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:13.706380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:13.706827 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:13.707582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:13.708037 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:13.736988 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-8bf2e7e9-f9a5-4cb5-8276-9ce917b1c383 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Jun 06 20:52:13.737527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 457/925] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:52:13 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:14.348349 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:14.348958 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:14.355469 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:14.356062 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:14.356827 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:14.357261 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:14.483569 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:14.491274 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-af271e27-84ab-4d36-ac94-5c28bcfff376 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1515 microversion: 2.1 time: 0.146785 Jun 06 20:52:14.491862 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 469/926] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:14 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:14.749662 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:14.750595 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:14.757239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:14.757688 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:14.758971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:14.759407 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:14.790245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c98ee65f-493a-4202-91e7-adc8c477d3f1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Jun 06 20:52:14.790844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 458/927] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:52:14 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:15.340083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-1638a7e7-c327-4cc2-b1d6-8de9483250af req-16b3e398-c70e-4ce3-b934-029d671cd915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a494b-61bd-4344-97b1-4779c9875146", "name": "network-vif-deleted", "tag": "65bc07d4-97bd-4848-88f2-3be41e8f2ad1"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:15.348144 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-1638a7e7-c327-4cc2-b1d6-8de9483250af req-16b3e398-c70e-4ce3-b934-029d671cd915 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.355346 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-1638a7e7-c327-4cc2-b1d6-8de9483250af req-16b3e398-c70e-4ce3-b934-029d671cd915 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.360177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-1638a7e7-c327-4cc2-b1d6-8de9483250af req-16b3e398-c70e-4ce3-b934-029d671cd915 service nova] Creating event network-vif-deleted:65bc07d4-97bd-4848-88f2-3be41e8f2ad1 for instance 187a494b-61bd-4344-97b1-4779c9875146 on hv-cinder-84487 Jun 06 20:52:15.365080 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-1638a7e7-c327-4cc2-b1d6-8de9483250af req-16b3e398-c70e-4ce3-b934-029d671cd915 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028686 Jun 06 20:52:15.365656 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 470/928] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:15.509840 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:15.510454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:15.516734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.517186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.517956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.518401 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.581028 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4faf2daf884d7fb15cda3bcd17c074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411e8573a7b94719bc65378204cbc53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:15.589038 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2abca567-095a-414e-9e39-ec8495f7f10b tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 200 len: 1304 microversion: 2.1 time: 0.083650 Jun 06 20:52:15.589597 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 459/929] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:15 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:15.802054 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:15.803061 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:15.809838 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.810287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.811044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.811475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.839647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-26e3bc46-dca7-4e0c-8fb4-df10e35d2721 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041935 Jun 06 20:52:15.840164 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 471/930] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:52:15 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:52:15.896232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:15.896975 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:15.903651 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.904179 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.905356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:15.905455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:15.930409 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:52:16.203093 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5c6ae164-9e3d-4e9d-b02d-ce43de0ef847 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 204 len: 0 microversion: 2.1 time: 0.311069 Jun 06 20:52:16.203693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 460/931] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:52:15 2022] DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:52:16.213017 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:16.213782 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:16.220127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:16.220564 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:16.221312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:16.221740 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:16.354788 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:16.362583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-487bfe45-ed1f-4b15-902d-74240e6aeacf tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1680 microversion: 2.1 time: 0.154421 Jun 06 20:52:16.363157 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 472/932] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:16 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:16.606364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:16.607031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] [instance: 187a494b-61bd-4344-97b1-4779c9875146] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:16.613203 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:16.613643 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:16.614393 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:16.614823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:16.628464 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] HTTP exception thrown: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Request method failure captured: Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 HTTP/1.1 Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmiP7K7_zNMmOv5_lawzs8CBgZ7U4HWrOOH-VhipGdt4UcllEIdEittJM1YmwT11jB1TK5oe9r--cLAGJ7X19I1zPGhcwle51gAGqAwRlOjUP9J77V_qBfdpVVQp_tbJv9_Z93sXwtmxRJPBzAuZOGHdEU_jBs-zLiP2KpRnXXFB6WA Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 411e8573a7b94719bc65378204cbc53d Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:52:16.630095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/411e8573a7b94719bc65378204cbc53d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_411e8573a7b94719bc65378204cbc53d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 411e8573a7b94719bc65378204cbc53d Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1231069048 Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesSnapshotTestJSON-1231069048-project Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 1b4faf2daf884d7fb15cda3bcd17c074 Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesSnapshotTestJSON-1231069048-project Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. Jun 06 20:52:16.631799 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '187a494b-61bd-4344-97b1-4779c9875146'} Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:52:16.632798 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. Jun 06 20:52:16.634328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:52:16.636642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] Returning 404 to user: Instance 187a494b-61bd-4344-97b1-4779c9875146 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:52:16.636642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-2412052c-7ad8-489c-844f-6de5025e31e6 tempest-VolumesSnapshotTestJSON-1231069048 tempest-VolumesSnapshotTestJSON-1231069048-project] 10.222.0.41 "GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146" status: 404 len: 111 microversion: 2.1 time: 0.029392 Jun 06 20:52:16.636642 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 461/933] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:16 2022] GET /compute/v2.1/servers/187a494b-61bd-4344-97b1-4779c9875146 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:52:17.379350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:17.379975 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:17.387377 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:17.387859 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:17.388631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:17.389069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:17.516378 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:17.524100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b7dfe48b-3885-4312-a406-a866150e27d3 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1680 microversion: 2.1 time: 0.148562 Jun 06 20:52:17.524746 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 473/934] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:17 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:18.541201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:18.541813 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:18.547921 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:18.548364 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:18.549127 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:18.549700 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:18.627379 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:18.632717 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-05adb02a-5574-4d38-bec0-6737c1b5acaa tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1612 microversion: 2.1 time: 0.095403 Jun 06 20:52:18.643350 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 462/935] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:18 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1612 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:18.664339 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-2ed28da1-19c8-4424-951b-e112da0d911e req-a6aead14-4af3-466c-aad9-a60154f64fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9605bdb5-388f-4e9b-8c26-03cc2ba503f3", "name": "network-vif-deleted", "tag": "26d9db88-6fd1-4a7f-b035-bdb713b5a005"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:18.672955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-2ed28da1-19c8-4424-951b-e112da0d911e req-a6aead14-4af3-466c-aad9-a60154f64fa7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:18.673386 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-2ed28da1-19c8-4424-951b-e112da0d911e req-a6aead14-4af3-466c-aad9-a60154f64fa7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:18.685029 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-2ed28da1-19c8-4424-951b-e112da0d911e req-a6aead14-4af3-466c-aad9-a60154f64fa7 service nova] Creating event network-vif-deleted:26d9db88-6fd1-4a7f-b035-bdb713b5a005 for instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 on hv-cinder-84487 Jun 06 20:52:18.690032 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-2ed28da1-19c8-4424-951b-e112da0d911e req-a6aead14-4af3-466c-aad9-a60154f64fa7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029448 Jun 06 20:52:18.690631 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 474/936] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:19.651141 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:19.651779 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:19.658629 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:19.659129 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:19.659950 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:19.660393 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:19.692264 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:19.692627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:19.693086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'fault' on Instance uuid 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:52:19.734000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:19.744098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-791df9f1-be7a-4b91-b93b-f0328a8fbb76 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1330 microversion: 2.1 time: 0.097399 Jun 06 20:52:19.744710 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 463/937] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:19 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:20.763277 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:20.764044 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:20.770254 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:20.770703 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:20.771468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:20.771935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:20.801818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:20.802266 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:20.802712 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'fault' on Instance uuid 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:52:20.846084 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:20.853549 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1a58696c-9f96-4185-a264-7745e5372e06 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1330 microversion: 2.1 time: 0.095716 Jun 06 20:52:20.854195 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 475/938] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:20 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:21.870612 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:21.871410 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:21.877727 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:21.878636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:21.879175 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:21.879747 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:21.920764 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:21.921782 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:21.922430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'fault' on Instance uuid 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:52:21.974756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:21.983024 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-7c87fff0-4c19-4e4c-8a57-8978c6669b6f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 200 len: 1330 microversion: 2.1 time: 0.116431 Jun 06 20:52:21.983593 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 464/939] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:21 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:23.000601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:23.001179 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:23.007810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:23.008253 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:23.009009 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:23.009438 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:23.022865 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 HTTP/1.1 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:52:23.027620 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:52:23.029347 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '9605bdb5-388f-4e9b-8c26-03cc2ba503f3'} Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:52:23.030290 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:52:23.031930 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:52:23.033358 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:52:23.033358 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8c474282-3173-4d27-a240-1a2c805f3571 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 404 len: 111 microversion: 2.1 time: 0.029362 Jun 06 20:52:23.033358 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 476/940] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:22 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:52:23.034752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f708f8ff-c3c6-44a8-bf12-02c63134bc16 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '.version_select at 0x7fdaea4529d0>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:23.164627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f708f8ff-c3c6-44a8-bf12-02c63134bc16 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995805505" status: 202 len: 0 microversion: 2.1 time: 0.133739 Jun 06 20:52:23.165202 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 465/941] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 20:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995805505 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:52:23.904063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8653c065-1728-48d2-affd-dffeb2566f5a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: .version_select at 0x7fdaea1f8160>, body: {"keypair": {"name": "tempest-keypair-891429586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF6arr+5Q44TJsvppkMtYlR6plyjgE2/bXIplS6IZ5FPemSq/J0/z+q2tiF/3DmaDbo2YODl5pPDlS9ULu8lrwAxJHAWX0HfC4IycJVBH69Q4pcHVjHe3Aid95lngB72Q=="}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:23.918307 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8653c065-1728-48d2-affd-dffeb2566f5a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:52:23.922078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8653c065-1728-48d2-affd-dffeb2566f5a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'key_pairs'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:52:24.033126 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8653c065-1728-48d2-affd-dffeb2566f5a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133505 Jun 06 20:52:24.033833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 477/942] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 20:52:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:26.171374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-965470652", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba219d3c-acea-4b6a-9365-0ffc461448ec"}], "security_groups": [{"name": "tempest-securitygroup--2014254310"}], "key_name": "tempest-keypair-891429586", "user_data": "}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:26.274508 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] validate_networks() for [('ba219d3c-acea-4b6a-9365-0ffc461448ec', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:52:26.648756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:52:26.649176 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:52:26.659214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:52:26.659214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:52:26.659214 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:52:26.659704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:26.660158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:26.660956 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:26.661391 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:26.668042 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:26.678200 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:52:26.682088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Getting quotas for user 7e7e03514f454d40aed80b81acab82ca and project 19e92b8219814afd94d3d49bf9f13f30. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:52:26.692951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:52:26.695171 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:52:26.834101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-70544cb1-3057-4af3-bd44-5eb7833b48e5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.667560 Jun 06 20:52:26.834890 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 466/943] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:52:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:52:26.845104 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e07fa5bf-cdc8-4ea4-9435-552344b1226c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:26.845837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e07fa5bf-cdc8-4ea4-9435-552344b1226c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:26.900435 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e07fa5bf-cdc8-4ea4-9435-552344b1226c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:26.907478 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e07fa5bf-cdc8-4ea4-9435-552344b1226c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1240 microversion: 2.1 time: 0.066713 Jun 06 20:52:26.908263 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 478/944] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:26 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:52:27.925558 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:27.926164 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:27.933630 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:27.934027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:27.934790 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:27.935227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:27.996057 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:28.003804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1af1a0f0-dd33-40ce-a5b4-cea299327c6a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1244 microversion: 2.1 time: 0.082855 Jun 06 20:52:28.004365 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 467/945] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:27 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:52:29.020853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:29.021462 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:29.028632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:29.029065 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:29.029827 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:29.030266 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:29.090789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:29.098118 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-85e3e11c-16c2-4155-8396-9440e8c0a935 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1236 microversion: 2.1 time: 0.081123 Jun 06 20:52:29.098669 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 479/946] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:29 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:30.114400 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:30.115088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:30.123978 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:30.124513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:30.125210 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:30.125679 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:30.192552 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:30.202080 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3f2de5a8-131a-4d92-bf96-bc326bb4c373 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1300 microversion: 2.1 time: 0.091536 Jun 06 20:52:30.202665 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 468/947] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:30 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:31.219179 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:31.220573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:31.228558 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:31.229834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:31.230855 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:31.232259 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:31.469819 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:31.477331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f4b763e0-def2-400d-a2e1-c8fffb30d04c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.262085 Jun 06 20:52:31.477898 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 480/948] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:31 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:32.138510 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-1300c74e-678e-4758-a65e-16d6d6690adc req-1681a4d3-c587-454e-89df-75aa95f2c7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ab1dab-0080-4e61-8a80-4dcb6c7e7600", "tag": "d5a6642b-89ad-4363-b49c-8f8babef427a"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:32.149178 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1300c74e-678e-4758-a65e-16d6d6690adc req-1681a4d3-c587-454e-89df-75aa95f2c7d6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:32.149866 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-1300c74e-678e-4758-a65e-16d6d6690adc req-1681a4d3-c587-454e-89df-75aa95f2c7d6 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:32.161949 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-1300c74e-678e-4758-a65e-16d6d6690adc req-1681a4d3-c587-454e-89df-75aa95f2c7d6 service nova] Creating event network-changed:d5a6642b-89ad-4363-b49c-8f8babef427a for instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 on hv-cinder-84487 Jun 06 20:52:32.167426 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-1300c74e-678e-4758-a65e-16d6d6690adc req-1681a4d3-c587-454e-89df-75aa95f2c7d6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Jun 06 20:52:32.168279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 469/949] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:32.502102 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:32.502828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:32.509552 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:32.510019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:32.510866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:32.511642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:32.740962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:32.748794 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9ca56f31-9325-49ba-bcbd-615e0d150339 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.250599 Jun 06 20:52:32.749410 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 481/950] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:32 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:33.768451 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:33.769777 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:33.778715 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:33.779170 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:33.779970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:33.780412 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:33.917477 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:33.925239 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-29dfe451-0209-4bd6-b3cb-93b4ec70d0d1 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.162145 Jun 06 20:52:33.925795 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 470/951] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:33 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:34.942743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:34.965006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:34.965006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:34.965006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:34.965006 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:34.965453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:35.089916 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:35.097558 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5fff4320-a987-4192-8d03-2614f1974e12 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.158749 Jun 06 20:52:35.098128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 482/952] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:34 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:36.115742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:36.116358 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:36.123509 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:36.123990 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:36.124752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:36.125186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:36.255384 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:36.263158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-002a33c5-2a6d-4dd1-8f3c-41c93e9986a9 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.151260 Jun 06 20:52:36.263741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 471/953] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:36 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:37.280212 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:37.280820 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:37.283223 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:37.288081 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:37.288534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:37.289297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:37.289732 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:37.420351 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:37.427902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-60e7e28a-b97b-450d-9be5-dc98f2b2f6c2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.151434 Jun 06 20:52:37.428413 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 483/954] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:37 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:38.444704 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:38.445255 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:38.447154 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.447839 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=6 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.453158 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:38.453604 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:38.454365 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:38.454802 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:38.590031 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:38.597650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cc75940a-3f54-4d8b-9a6b-1c45270fb186 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.156932 Jun 06 20:52:38.598211 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 472/955] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:38 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:38.873306 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-b9ad44d6-16be-417e-a859-d3041be12fc7 req-afd986e5-e697-43dc-ac15-ccf6cd096f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab1dab-0080-4e61-8a80-4dcb6c7e7600", "name": "network-vif-plugged", "status": "completed", "tag": "d5a6642b-89ad-4363-b49c-8f8babef427a"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:38.881885 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b9ad44d6-16be-417e-a859-d3041be12fc7 req-afd986e5-e697-43dc-ac15-ccf6cd096f30 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:38.882355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-b9ad44d6-16be-417e-a859-d3041be12fc7 req-afd986e5-e697-43dc-ac15-ccf6cd096f30 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:38.894556 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-b9ad44d6-16be-417e-a859-d3041be12fc7 req-afd986e5-e697-43dc-ac15-ccf6cd096f30 service nova] Creating event network-vif-plugged:d5a6642b-89ad-4363-b49c-8f8babef427a for instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 on hv-cinder-84487 Jun 06 20:52:38.899934 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-b9ad44d6-16be-417e-a859-d3041be12fc7 req-afd986e5-e697-43dc-ac15-ccf6cd096f30 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 Jun 06 20:52:38.900527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 484/956] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:52:39.614260 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:39.614871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:39.617154 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:39.621893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:39.622337 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:39.623097 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:39.623527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:39.750653 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:39.758034 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-edce96b9-84f0-432a-be4a-c7279c5dd07f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.147635 Jun 06 20:52:39.758657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 473/957] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:39 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:40.776355 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:40.777183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:40.784806 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:40.785244 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:40.785998 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:40.786426 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:40.921143 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:40.929823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0d54d341-56ce-4ddc-aa40-0eb484b11a11 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1366 microversion: 2.1 time: 0.157726 Jun 06 20:52:40.938566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 485/958] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:40 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:41.946218 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:41.946909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:41.954819 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:41.958336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:41.958336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:41.958336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:42.104513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:52:42.113284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-160bc4f3-2c94-46e5-8836-ea59b35ebb4f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1556 microversion: 2.1 time: 0.170921 Jun 06 20:52:42.113858 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 474/959] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:52:41 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:52:42.129810 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:52:42.130359 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:52:42.137799 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:42.138250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:42.139018 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:42.139456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:42.216503 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-c130fd71-e818-4130-b909-7f46b9d60213 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090557 Jun 06 20:52:42.217098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 486/960] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 20:52:42 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:52:43.231159 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-8bc1ce00-ca77-4032-ba0c-c942b65a4b98 req-346da940-7de3-43f4-8a33-87cd385ad61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ab1dab-0080-4e61-8a80-4dcb6c7e7600", "tag": "d5a6642b-89ad-4363-b49c-8f8babef427a"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:52:43.243091 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8bc1ce00-ca77-4032-ba0c-c942b65a4b98 req-346da940-7de3-43f4-8a33-87cd385ad61c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:52:43.243511 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-8bc1ce00-ca77-4032-ba0c-c942b65a4b98 req-346da940-7de3-43f4-8a33-87cd385ad61c service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:52:43.254971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-8bc1ce00-ca77-4032-ba0c-c942b65a4b98 req-346da940-7de3-43f4-8a33-87cd385ad61c service nova] Creating event network-changed:d5a6642b-89ad-4363-b49c-8f8babef427a for instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 on hv-cinder-84487 Jun 06 20:52:43.260508 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-8bc1ce00-ca77-4032-ba0c-c942b65a4b98 req-346da940-7de3-43f4-8a33-87cd385ad61c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035576 Jun 06 20:52:43.266369 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 475/961] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:19.498636 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:19.499297 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=98 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:19.503170 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:19.503654 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:19.509466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:19.510748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:19.510908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:19.511338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:19.535158 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e83238d5-4926-452a-a84f-a45e82483be2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/ips" status: 200 len: 150 microversion: 2.1 time: 0.038203 Jun 06 20:53:19.535737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 487/962] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:53:19 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:21.007695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=5 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:21.008962 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=46 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:21.014860 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f9e0d9-9ffe-403b-a8fd-5f11c202b0a0"}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:21.016691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:21.023696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:21.024328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:21.025137 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:21.043617 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:21.818101 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-0f35b685-32a4-4c07-b06e-5bd6879145f2 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "POST /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812852 Jun 06 20:53:21.818724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 476/963] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 20:53:21 2022] POST /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:30.463223 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:30.463786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:30.471099 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:30.471542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:30.472319 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:30.472748 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:30.553363 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.objects.instance [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lazy-loading 'services' on Instance uuid 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 {{(pid=124579) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:53:30.790328 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-6e9e61a0-9c06-421a-a212-cd00f4f8c989 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments/06f9e0d9-9ffe-403b-a8fd-5f11c202b0a0" status: 202 len: 0 microversion: 2.1 time: 0.331118 Jun 06 20:53:30.790924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 488/964] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 20:53:30 2022] DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments/06f9e0d9-9ffe-403b-a8fd-5f11c202b0a0 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:53:30.801230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:30.802243 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:30.808352 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:30.808804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:30.809644 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:30.810072 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:30.839533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e3a4f8ca-d48b-4224-981b-733ee428293b tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043355 Jun 06 20:53:30.840144 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 477/965] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:53:30 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:31.858100 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:31.859095 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:31.865251 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:31.865687 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:31.866439 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:31.866972 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:31.897059 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-4068e4ba-1ab7-4b67-90d2-fd22c95c4301 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Jun 06 20:53:31.897598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 489/966] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:53:31 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:32.908627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:32.909567 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:32.916246 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:32.916692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:32.917443 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:32.917870 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:32.945893 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-d102364c-3929-4397-bb59-2ea4b158a901 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Jun 06 20:53:32.946424 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 478/967] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:53:32 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:33.957845 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:33.958785 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:33.965331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:33.965776 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:33.966540 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:33.966973 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:33.995014 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-652fbc30-8d0b-4e15-956c-631ebd98e71a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041628 Jun 06 20:53:33.995562 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 490/968] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 20:53:33 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 20:53:34.051845 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:34.052357 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:34.058844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.059292 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.060087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.060546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.085338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:53:34.276215 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-936494603", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1910891760", "security_groups": [{"name": "tempest-secgroup-smoke-561185832"}], "block_device_mapping_v2": [{"uuid": "8ce6f6d8-e00f-4b20-9625-e417bef2e265", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b263e80-04f0-46e3-a24e-eb32fd6a6da0"}]}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:34.362228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cb38e4f3-8915-493a-9841-6b29871c412f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 204 len: 0 microversion: 2.1 time: 0.313925 Jun 06 20:53:34.362820 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 479/969] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:53:34 2022] DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:53:34.371605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:34.373476 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:34.379478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.380047 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.380814 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.381273 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.392449 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.network.neutron [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] validate_networks() for [('8b263e80-04f0-46e3-a24e-eb32fd6a6da0', None, None, None, None, None)] {{(pid=124579) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:53:34.515274 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:34.523385 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5ee23e01-999a-4a41-95e9-0d400cec329d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1681 microversion: 2.1 time: 0.156081 Jun 06 20:53:34.524041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 480/970] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:34 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:53:34.811981 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:53:34.812402 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image limits 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:53:34.812908 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Flavor pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:53:34.813366 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Image pref 0:0:0 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:53:34.813772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.virt.hardware [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124579) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:53:34.823222 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.823683 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.824486 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:34.824920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:34.841673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:53:34.846258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.quota [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Getting quotas for user 2bb3e3fc9a494cdf8abd264038af044c and project c1ea53cfd795419cacebe7f2d071f37f. Resources: {'instances', 'cores', 'ram'} {{(pid=124579) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:53:34.900696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Going to run 1 instances... {{(pid=124579) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:53:34.902760 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ce6f6d8-e00f-4b20-9625-e417bef2e265',volume_size=None,volume_type=None)] {{(pid=124579) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:53:35.261068 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8fd368f2-8a50-44b9-a74d-dbd41788d6ae tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988604 Jun 06 20:53:35.261918 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 491/971] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:53:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 20:53:35.272022 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1b8ff585-6053-482c-bc93-57e86c24676e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:35.272634 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1b8ff585-6053-482c-bc93-57e86c24676e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:35.324843 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1b8ff585-6053-482c-bc93-57e86c24676e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:35.332125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1b8ff585-6053-482c-bc93-57e86c24676e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1094 microversion: 2.1 time: 0.063841 Jun 06 20:53:35.332692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 481/972] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:35 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:35.539741 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:35.540392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:35.550127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:35.550127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:35.550127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:35.550127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:35.680566 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:35.688693 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-04ba5cbc-2e2f-4337-b32e-1380c221b52f tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1681 microversion: 2.1 time: 0.152313 Jun 06 20:53:35.689254 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 492/973] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:35 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:36.351927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:36.352808 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:36.361820 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:36.362397 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:36.363245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:36.363796 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:36.424817 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:36.432562 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-b799fb4f-70b8-49e5-b5b3-156fa2a5722a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1136 microversion: 2.1 time: 0.085299 Jun 06 20:53:36.433125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 482/974] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:36 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:36.706350 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:36.706965 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:36.713526 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:36.713980 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:36.714752 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:36.715191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:36.790637 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7e03514f454d40aed80b81acab82ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e92b8219814afd94d3d49bf9f13f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:36.801171 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-99482f77-3629-48ac-a0d9-73af398e287d tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 200 len: 1613 microversion: 2.1 time: 0.098586 Jun 06 20:53:36.810499 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 493/975] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:36 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:36.890701 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-fb3f6c33-bddc-49b1-8b3a-47047df1263f req-0fb24aa7-e5e9-4b80-b9d7-181a57ac19b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ab1dab-0080-4e61-8a80-4dcb6c7e7600", "name": "network-vif-deleted", "tag": "d5a6642b-89ad-4363-b49c-8f8babef427a"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:36.899856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-fb3f6c33-bddc-49b1-8b3a-47047df1263f req-0fb24aa7-e5e9-4b80-b9d7-181a57ac19b7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:36.900294 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-fb3f6c33-bddc-49b1-8b3a-47047df1263f req-0fb24aa7-e5e9-4b80-b9d7-181a57ac19b7 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:36.912463 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-fb3f6c33-bddc-49b1-8b3a-47047df1263f req-0fb24aa7-e5e9-4b80-b9d7-181a57ac19b7 service nova] Creating event network-vif-deleted:d5a6642b-89ad-4363-b49c-8f8babef427a for instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 on hv-cinder-84487 Jun 06 20:53:36.919863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-fb3f6c33-bddc-49b1-8b3a-47047df1263f req-0fb24aa7-e5e9-4b80-b9d7-181a57ac19b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187660 Jun 06 20:53:36.919863 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 483/976] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:53:37.449609 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:37.460371 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:37.466303 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:37.467063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:37.468045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:37.468647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:37.541193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:37.549640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-2b255a08-a751-4615-ab1c-fc427a308977 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1210 microversion: 2.1 time: 0.103926 Jun 06 20:53:37.550201 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 494/977] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:37 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:37.818343 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:37.819036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:37.825121 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:37.825565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:37.826319 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:37.826749 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:37.840804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 HTTP/1.1 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:37.842423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:37.844877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '98ab1dab-0080-4e61-8a80-4dcb6c7e7600'} Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:37.845897 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:37.847496 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:37.849460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:37.849460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a8ba6770-e536-4123-95b8-318f78378c56 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jun 06 20:53:37.849460 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 484/978] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:37 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:37.854778 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d51178dc-ce1b-44a9-b860-cfef1a1a8e68 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '.version_select at 0x7fdaeaea6160>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:37.974694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d51178dc-ce1b-44a9-b860-cfef1a1a8e68 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891429586" status: 202 len: 0 microversion: 2.1 time: 0.123671 Jun 06 20:53:37.975272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 495/979] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 20:53:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891429586 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:53:38.574448 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:38.575230 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:38.581585 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:38.582372 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:38.583986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:38.584676 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:38.753926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:38.761912 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-99e948f3-610c-4a30-9acc-94c6e404f126 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.191356 Jun 06 20:53:38.762478 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 485/980] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:38 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:39.175250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-3ddb07a3-2dab-430b-a277-3730c0e21886 req-4fc82dad-0bee-4ed7-ae38-373dd8de5ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60146555-8874-4e5f-b32c-203764e98af2", "tag": "26cf061b-b4d3-4ad4-8e9f-eec0d8e205df"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:39.192372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-3ddb07a3-2dab-430b-a277-3730c0e21886 req-4fc82dad-0bee-4ed7-ae38-373dd8de5ada service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:39.193118 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-3ddb07a3-2dab-430b-a277-3730c0e21886 req-4fc82dad-0bee-4ed7-ae38-373dd8de5ada service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:39.205240 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-3ddb07a3-2dab-430b-a277-3730c0e21886 req-4fc82dad-0bee-4ed7-ae38-373dd8de5ada service nova] Creating event network-changed:26cf061b-b4d3-4ad4-8e9f-eec0d8e205df for instance 60146555-8874-4e5f-b32c-203764e98af2 on hv-cinder-84487 Jun 06 20:53:39.210260 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-3ddb07a3-2dab-430b-a277-3730c0e21886 req-4fc82dad-0bee-4ed7-ae38-373dd8de5ada service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039455 Jun 06 20:53:39.210866 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 496/981] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:39.778312 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:39.778927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:39.785943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:39.785943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:39.787227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:39.787227 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:39.920815 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:39.928909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-894dd903-504f-4f3b-a94c-30b00f869232 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.154553 Jun 06 20:53:39.929475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 486/982] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:39 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:40.218190 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:40.218776 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:40.225011 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.225456 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:40.226232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.226647 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:40.239984 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 HTTP/1.1 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:40.241628 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.243354 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '98ab1dab-0080-4e61-8a80-4dcb6c7e7600'} Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:40.244372 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.245895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.247634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:40.247634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-da59a3ab-48cf-45bd-9865-8dcbcce6ee83 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 404 len: 111 microversion: 2.1 time: 0.029426 Jun 06 20:53:40.247634 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 497/983] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:53:40 2022] DELETE /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:40.251943 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:40.252546 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 98ab1dab-0080-4e61-8a80-4dcb6c7e7600] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:40.258804 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.259275 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:40.260305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.260742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:40.274280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 HTTP/1.1 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:40.275842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.277533 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '98ab1dab-0080-4e61-8a80-4dcb6c7e7600'} Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:40.278695 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. Jun 06 20:53:40.280380 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:40.281748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 98ab1dab-0080-4e61-8a80-4dcb6c7e7600 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:40.281748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-77578d3c-5252-4e60-8d83-51d04da97723 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600" status: 404 len: 111 microversion: 2.1 time: 0.029608 Jun 06 20:53:40.281748 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 487/984] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:40 2022] GET /compute/v2.1/servers/98ab1dab-0080-4e61-8a80-4dcb6c7e7600 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:40.945842 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:40.946444 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:40.952392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.952830 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:40.953719 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:40.954156 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.087364 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:41.095289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3ce27ba2-8308-4041-8da9-9eedf886c48e tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.153469 Jun 06 20:53:41.095869 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 498/985] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:40 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:41.807143 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:41.807637 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:41.814095 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.814536 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.815286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.815743 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.830812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 HTTP/1.1 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:41.832367 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.833974 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '9605bdb5-388f-4e9b-8c26-03cc2ba503f3'} Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:41.834841 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.836330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.838032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:41.838032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-f62b4fac-947b-442f-9549-30188e807a4c tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 404 len: 111 microversion: 2.1 time: 0.030605 Jun 06 20:53:41.838032 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 488/986] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:53:41 2022] DELETE /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:41.842331 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:41.842935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 9605bdb5-388f-4e9b-8c26-03cc2ba503f3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:41.850135 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.850584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.851356 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.851823 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.867031 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 HTTP/1.1 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:41.868563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.870225 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '9605bdb5-388f-4e9b-8c26-03cc2ba503f3'} Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:41.871276 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. Jun 06 20:53:41.872848 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.874305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 9605bdb5-388f-4e9b-8c26-03cc2ba503f3 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:41.874305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-28ede189-af8c-4f93-b8dd-99ab656c607a tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3" status: 404 len: 111 microversion: 2.1 time: 0.031360 Jun 06 20:53:41.874305 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 499/987] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:41 2022] GET /compute/v2.1/servers/9605bdb5-388f-4e9b-8c26-03cc2ba503f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:41.878195 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:41.878691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:41.884627 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.885335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.886105 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.886517 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.901824 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 HTTP/1.1 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:41.903334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.905000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '3f01ee6d-2437-44c9-9fff-2325c77005a3'} Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:41.905937 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.907951 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.909598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:41.909598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-cf741c3e-0675-4097-8fd3-0bbe90b04a69 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 404 len: 111 microversion: 2.1 time: 0.031117 Jun 06 20:53:41.909598 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 489/988] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:53:41 2022] DELETE /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:41.914468 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:41.915069 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: 3f01ee6d-2437-44c9-9fff-2325c77005a3] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:41.921167 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.921607 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.922972 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:41.923400 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:41.936475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 HTTP/1.1 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:41.937952 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.939603 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '3f01ee6d-2437-44c9-9fff-2325c77005a3'} Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:41.940709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. Jun 06 20:53:41.942231 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:41.943828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance 3f01ee6d-2437-44c9-9fff-2325c77005a3 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:41.943828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-87dc7f04-11b1-49b4-83db-26f9df2ef69e tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3" status: 404 len: 111 microversion: 2.1 time: 0.028819 Jun 06 20:53:41.943828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 500/989] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:41 2022] GET /compute/v2.1/servers/3f01ee6d-2437-44c9-9fff-2325c77005a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:53:42.111516 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:42.112069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:42.118008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:42.118454 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:42.119218 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:42.119651 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:42.260742 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:42.268702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-5d77f2e2-2615-4544-9877-1d1b911f65d9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.161110 Jun 06 20:53:42.269254 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 490/990] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:42 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:43.202983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:43.203594 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:43.210140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.210583 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.211339 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.211801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.225450 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e HTTP/1.1 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:43.226995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.228812 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'd2f732c9-6be3-4383-8911-145cfc0de38e'} Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:43.229673 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.231183 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.232921 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:43.232921 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0de0ac3a-d0a9-4442-9163-80a6daa72212 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 404 len: 111 microversion: 2.1 time: 0.029305 Jun 06 20:53:43.232921 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 501/991] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:53:43 2022] DELETE /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:53:43.241842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:43.241842 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] [instance: d2f732c9-6be3-4383-8911-145cfc0de38e] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:43.248270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.248725 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.249488 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.249926 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.264345 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] HTTP exception thrown: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Request method failure captured: Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e HTTP/1.1 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgo7sC0TIVfZqn1fEf89l7g9-oAoA1vAa3BCHXf2LLsFijjmaXVuEoZCkKuLUU-5GSTrfSHsPaPbJplJX73DlFncnFVZDXDagxNK46G0nHWacdL6AGeYrKIz_OmT6ALUNkw06ilM1DW6HkyqHGUc51K8VUDCCZlar0Xi1kIneRrSHM Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:43.266480 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/19e92b8219814afd94d3d49bf9f13f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_19e92b8219814afd94d3d49bf9f13f30", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 19e92b8219814afd94d3d49bf9f13f30 Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-817077640 Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 7e7e03514f454d40aed80b81acab82ca Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-AttachVolumeNegativeTest-817077640-project Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.268209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': 'd2f732c9-6be3-4383-8911-145cfc0de38e'} Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:43.269241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. Jun 06 20:53:43.270734 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:43.272306 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] Returning 404 to user: Instance d2f732c9-6be3-4383-8911-145cfc0de38e could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:43.272306 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-72de4af6-a099-4f8d-b25b-53b209a72af5 tempest-AttachVolumeNegativeTest-817077640 tempest-AttachVolumeNegativeTest-817077640-project] 10.222.0.41 "GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e" status: 404 len: 111 microversion: 2.1 time: 0.034720 Jun 06 20:53:43.272306 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 491/992] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:43 2022] GET /compute/v2.1/servers/d2f732c9-6be3-4383-8911-145cfc0de38e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:43.284335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:43.284948 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:43.291098 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.291550 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.292352 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:43.292792 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:43.425645 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:43.433229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-f98b17a3-177e-448d-bfb6-007a9ebaad14 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.152631 Jun 06 20:53:43.433789 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 502/993] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:43 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:44.450607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:44.451201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:44.458971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:44.459429 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:44.460284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:44.460731 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:44.705916 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:44.713657 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a162a45e-fed3-4981-9562-bbed3c21b550 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.267038 Jun 06 20:53:44.714217 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 492/994] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:44 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:53:45.731182 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:45.735771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:45.735771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:45.735771 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=6 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:45.741153 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:45.741598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:45.742632 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:45.743066 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:45.878230 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:45.888517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d649ee41-603b-4129-8d3c-533d64ca934b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.161080 Jun 06 20:53:45.889504 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 503/995] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:45 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:46.908396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:46.908396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:46.911373 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:46.917818 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:46.918590 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:46.919534 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:46.920162 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:47.069757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:47.077279 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-344a5910-28b3-4795-8528-c9cbad19aa46 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.173844 Jun 06 20:53:47.077844 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 493/996] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:46 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:48.093684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:48.094817 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:48.102022 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:48.102475 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:48.103236 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:48.103686 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:48.239646 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:48.242962 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-387093eb-e6b7-419f-a718-de086cd0675f tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.153299 Jun 06 20:53:48.243527 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 504/997] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:48 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:48.601948 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6c52cd5b-bf37-452b-a51d-abf6b80fb180 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Action: 'create', calling method: .version_select at 0x7fdaea4d6280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1563505439", "metadata": {"Type": "work"}}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6c52cd5b-bf37-452b-a51d-abf6b80fb180 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 122 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:48.612421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1563505439", "metadata": {"Type": "work"}}} Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:53:48.614069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1563505439', 'metadata': {'Type': 'work'}}}} Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise error Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.615123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 20:53:48.616929 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 20:53:48.618181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 20:53:48.618181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.618181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-6c52cd5b-bf37-452b-a51d-abf6b80fb180 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.618181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-6c52cd5b-bf37-452b-a51d-abf6b80fb180 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122829 Jun 06 20:53:48.618181 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 494/998] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 20:53:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:53:48.623338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1eb99acd-3c9b-4226-bc55-144570238f58 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Action: 'create', calling method: .version_select at 0x7fdaea45caf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1150558123", "metadata": {"Type": "work"}}} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1eb99acd-3c9b-4226-bc55-144570238f58 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 120 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:48.626985 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1150558123", "metadata": {"Type": "work"}}} Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: Jun 06 20:53:48.628618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1150558123', 'metadata': {'Type': 'work'}}}} Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise error Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi '0' Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.629642 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 20:53:48.631289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 20:53:48.632834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 20:53:48.632834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.632834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-1eb99acd-3c9b-4226-bc55-144570238f58 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.632834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-1eb99acd-3c9b-4226-bc55-144570238f58 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008844 Jun 06 20:53:48.632834 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 505/999] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 20:53:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 20:53:48.637612 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c63dbde9-8d8a-415c-be76-8ba0b4c7e48a tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Action: 'create', calling method: .version_select at 0x7fdaea4529d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1805671986", "metadata": {"Type": "work"}}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c63dbde9-8d8a-415c-be76-8ba0b4c7e48a tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 119 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:48.639919 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1805671986", "metadata": {"Type": "work"}}} Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:53:48.642087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1805671986', 'metadata': {'Type': 'work'}}}} Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise error Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi '' Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.643081 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 20:53:48.644741 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 20:53:48.646258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 20:53:48.646258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.646258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c63dbde9-8d8a-415c-be76-8ba0b4c7e48a tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.646258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c63dbde9-8d8a-415c-be76-8ba0b4c7e48a tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008078 Jun 06 20:53:48.646258 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 495/1000] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 20:53:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 20:53:48.650615 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cbd1856b-07dc-48cb-ba86-71138395e292 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Calling method '.version_select at 0x7fdaea28a430>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:48.677458 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-cbd1856b-07dc-48cb-ba86-71138395e292 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] HTTP exception thrown: Volume tempest-invalid-1834017835 could not be found. Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cbd1856b-07dc-48cb-ba86-71138395e292 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1834017835 HTTP/1.1 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:48.680392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Volume tempest-invalid-1834017835 could not be found. Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'tempest-invalid-1834017835'} Jun 06 20:53:48.682033 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1834017835 could not be found. (HTTP 404) (Request-ID: req-7294f336-5cf0-42db-9761-e172a2211ad8) Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.682943 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:53:48.684484 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1834017835 could not be found. Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:48.685945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1834017835 could not be found. Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1834017835 could not be found. Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-cbd1856b-07dc-48cb-ba86-71138395e292 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 404 to user: Volume tempest-invalid-1834017835 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-cbd1856b-07dc-48cb-ba86-71138395e292 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1834017835" status: 404 len: 99 microversion: 2.1 time: 0.034586 Jun 06 20:53:48.687927 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 506/1001] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 20:53:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1834017835 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 06 20:53:48.692892 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-be769fe4-0c56-42f0-aa1a-ba09ee99bdc9 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003641 Jun 06 20:53:48.693405 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 496/1002] 10.222.0.41 () {58 vars in 1139 bytes} [Mon Jun 6 20:53:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 06 20:53:48.701078 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-a02f7c8a-d99a-4cc9-9ab9-1a8a8f1a9624 tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003487 Jun 06 20:53:48.701554 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 507/1003] 10.222.0.41 () {58 vars in 1136 bytes} [Mon Jun 6 20:53:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 06 20:53:48.710041 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-86392131-676e-498a-97de-8972bcc8e7dd tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Calling method '.version_select at 0x7fdaea437f70>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:48.737071 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-86392131-676e-498a-97de-8972bcc8e7dd tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] HTTP exception thrown: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-86392131-676e-498a-97de-8972bcc8e7dd tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/os-volumes/14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 HTTP/1.1 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:53:48.739058 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10'} Jun 06 20:53:48.740722 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. (HTTP 404) (Request-ID: req-b19b2420-fcb5-4d30-ae6c-6e174a1c2eda) Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.741753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 20:53:48.743293 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 20:53:48.744780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-86392131-676e-498a-97de-8972bcc8e7dd tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 404 to user: Volume 14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-86392131-676e-498a-97de-8972bcc8e7dd tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10" status: 404 len: 109 microversion: 2.1 time: 0.033907 Jun 06 20:53:48.746284 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 497/1004] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 20:53:48 2022] DELETE /compute/v2.1/os-volumes/14c96a3e-1ec3-4f23-9a3b-4cc273ed2c10 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:53:48.750619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e20d2cbb-fc96-4c21-a2d2-f9b10a71163e tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Calling method '.version_select at 0x7fdaea45caf0>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:48.777604 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-e20d2cbb-fc96-4c21-a2d2-f9b10a71163e tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] HTTP exception thrown: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e20d2cbb-fc96-4c21-a2d2-f9b10a71163e tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Request method failure captured: Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/os-volumes/f6bd56a4-ddba-479c-82d4-80984f96d4cf HTTP/1.1 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmlctj5DYHY-hzKr3-7tnAODIsqoVbCTp5G-fcYgxne5E1cXcajnQYldc3TvGOVMj-gUv38MENy9nmN41vP_nk7GBrgtizJ_I7EQ6vbHUsISHhNnjK9j7hq5TNLvyF1gtMDHGbhY477ZMbKvU-3JdVm6xvKZGAntOcVDL5yVGyXX-qI Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:53:48.779539 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0a814a9a1f2548d186ddb8b8ca826698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0a814a9a1f2548d186ddb8b8ca826698", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 0a814a9a1f2548d186ddb8b8ca826698 Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesNegativeTest-825962640 Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 8bb1a86fd0984338bd6e6a829266eb91 Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesNegativeTest-825962640-project Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'f6bd56a4-ddba-479c-82d4-80984f96d4cf'} Jun 06 20:53:48.781250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. (HTTP 404) (Request-ID: req-d1499b3d-a172-40e4-9815-9c59783b62fa) Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.782336 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 20:53:48.783773 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 20:53:48.785165 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e20d2cbb-fc96-4c21-a2d2-f9b10a71163e tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] Returning 404 to user: Volume f6bd56a4-ddba-479c-82d4-80984f96d4cf could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e20d2cbb-fc96-4c21-a2d2-f9b10a71163e tempest-VolumesNegativeTest-825962640 tempest-VolumesNegativeTest-825962640-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f6bd56a4-ddba-479c-82d4-80984f96d4cf" status: 404 len: 109 microversion: 2.1 time: 0.034587 Jun 06 20:53:48.786640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 508/1005] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 20:53:48 2022] GET /compute/v2.1/os-volumes/f6bd56a4-ddba-479c-82d4-80984f96d4cf => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 20:53:49.060934 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-f3f2ce85-ef45-4214-a14d-8bc2debb732c req-2feb5d14-68d0-45b6-ab61-41639116ecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60146555-8874-4e5f-b32c-203764e98af2", "name": "network-vif-plugged", "status": "completed", "tag": "26cf061b-b4d3-4ad4-8e9f-eec0d8e205df"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:49.070349 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f3f2ce85-ef45-4214-a14d-8bc2debb732c req-2feb5d14-68d0-45b6-ab61-41639116ecf9 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:49.075702 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-f3f2ce85-ef45-4214-a14d-8bc2debb732c req-2feb5d14-68d0-45b6-ab61-41639116ecf9 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:49.080986 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-f3f2ce85-ef45-4214-a14d-8bc2debb732c req-2feb5d14-68d0-45b6-ab61-41639116ecf9 service nova] Creating event network-vif-plugged:26cf061b-b4d3-4ad4-8e9f-eec0d8e205df for instance 60146555-8874-4e5f-b32c-203764e98af2 on hv-cinder-84487 Jun 06 20:53:49.085991 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-f3f2ce85-ef45-4214-a14d-8bc2debb732c req-2feb5d14-68d0-45b6-ab61-41639116ecf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081516 Jun 06 20:53:49.086607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 498/1006] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:53:49.261313 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:49.261909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:49.268874 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:49.269322 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:49.270092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:49.270520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:49.508684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:49.516920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b7d873cc-5a8f-4973-8027-2ace3c8622e9 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.261044 Jun 06 20:53:49.518338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 509/1007] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:49 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:50.535492 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:50.536220 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:50.546156 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:50.546302 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:50.547213 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:50.547656 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:50.553245 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:50.690218 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:50.697528 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9abfda1a-5e56-42f3-8c86-94e206baad28 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1265 microversion: 2.1 time: 0.167384 Jun 06 20:53:50.698075 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 499/1008] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:50 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:51.715258 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:51.716606 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:51.726245 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:51.726737 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:51.727902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:51.728604 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:51.876557 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:51.884241 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-df1416a4-5fa0-42d1-8ead-9381fe71012c tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1453 microversion: 2.1 time: 0.173627 Jun 06 20:53:51.885148 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 510/1009] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:51 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:51.902923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:53:51.903541 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:53:51.905828 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:51.911423 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:51.911909 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:51.912681 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:51.913123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:52.041439 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:53:52.049724 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-263621f6-76ea-4728-be38-46968dbd1e06 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1453 microversion: 2.1 time: 0.150914 Jun 06 20:53:52.051209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 500/1010] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:53:51 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:53:54.356480 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-253ada95-861d-4b8a-b75c-60bc1020618a req-e3b16a0f-92cf-49f7-a7fe-6bca1e4a0e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60146555-8874-4e5f-b32c-203764e98af2", "tag": "26cf061b-b4d3-4ad4-8e9f-eec0d8e205df"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:53:54.365024 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-253ada95-861d-4b8a-b75c-60bc1020618a req-e3b16a0f-92cf-49f7-a7fe-6bca1e4a0e98 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:53:54.365466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-253ada95-861d-4b8a-b75c-60bc1020618a req-e3b16a0f-92cf-49f7-a7fe-6bca1e4a0e98 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:53:54.377573 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-253ada95-861d-4b8a-b75c-60bc1020618a req-e3b16a0f-92cf-49f7-a7fe-6bca1e4a0e98 service nova] Creating event network-changed:26cf061b-b4d3-4ad4-8e9f-eec0d8e205df for instance 60146555-8874-4e5f-b32c-203764e98af2 on hv-cinder-84487 Jun 06 20:53:54.382813 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-253ada95-861d-4b8a-b75c-60bc1020618a req-e3b16a0f-92cf-49f7-a7fe-6bca1e4a0e98 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154071 Jun 06 20:53:54.383630 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 511/1011] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:13.753021 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1067131446", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "networks": [{"uuid": "13b69029-da1f-430c-b77e-8c726d2efcc5"}]}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:13.761370 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=10 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:13.806138 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] validate_networks() for [('13b69029-da1f-430c-b77e-8c726d2efcc5', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:54:14.202018 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:54:14.202445 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:54:14.202923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:54:14.203335 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:54:14.203780 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:54:14.214036 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:14.214482 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:14.215274 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:14.215745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:14.232775 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Getting quotas for project 615b738dad2c43d8a7cef6086bb467de. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:54:14.236760 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Getting quotas for user ea091ae58b114083abd29801f6d8baff and project 615b738dad2c43d8a7cef6086bb467de. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:54:14.247812 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:54:14.250130 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:54:14.362713 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3b97dd3d-e5d2-4e43-be1f-2d5d5f3c8904 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613457 Jun 06 20:54:14.363371 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 501/1012] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:54:14.373919 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d137aabc-ce75-4f14-a71b-77867ac47927 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:14.374622 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d137aabc-ce75-4f14-a71b-77867ac47927 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:14.377289 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:14.377929 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:14.436931 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d137aabc-ce75-4f14-a71b-77867ac47927 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:14.444694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d137aabc-ce75-4f14-a71b-77867ac47927 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1214 microversion: 2.1 time: 0.074986 Jun 06 20:54:14.445257 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 512/1013] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:14 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:15.462579 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:15.463183 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:15.469318 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:15.473961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:15.473961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:15.473961 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:15.536406 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:15.544472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-92f92af8-297c-4ce3-8942-ecd3da85df26 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1218 microversion: 2.1 time: 0.086556 Jun 06 20:54:15.545027 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 502/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:15 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:16.562221 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:16.562786 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:16.572516 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:16.572957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:16.573731 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:16.574163 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:16.773727 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:16.781140 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-053c9a32-8c07-46af-b9e5-aa8b12b52268 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1272 microversion: 2.1 time: 0.222955 Jun 06 20:54:16.781695 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 513/1015] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:16 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:17.798543 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:17.799108 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:17.805201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:17.805666 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:17.806430 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:17.806864 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:17.933983 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:17.942201 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-e54ce789-5037-41f2-a13f-29c2f16f5b32 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.147208 Jun 06 20:54:17.942765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 503/1016] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:17 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:18.232895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-200b9d88-5c9b-46aa-b495-31e00fa9ffe0 req-0c7e1909-97e9-4a58-947a-a09764cc4880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5de8f42-935f-4a9c-901b-baa02c97cf7d", "tag": "720d2265-0788-4ed9-b18f-2ee6dc53026f"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:18.243824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-200b9d88-5c9b-46aa-b495-31e00fa9ffe0 req-0c7e1909-97e9-4a58-947a-a09764cc4880 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:18.244499 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-200b9d88-5c9b-46aa-b495-31e00fa9ffe0 req-0c7e1909-97e9-4a58-947a-a09764cc4880 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:18.258408 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-200b9d88-5c9b-46aa-b495-31e00fa9ffe0 req-0c7e1909-97e9-4a58-947a-a09764cc4880 service nova] Creating event network-changed:720d2265-0788-4ed9-b18f-2ee6dc53026f for instance c5de8f42-935f-4a9c-901b-baa02c97cf7d on hv-cinder-84487 Jun 06 20:54:18.260679 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-200b9d88-5c9b-46aa-b495-31e00fa9ffe0 req-0c7e1909-97e9-4a58-947a-a09764cc4880 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031434 Jun 06 20:54:18.261272 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 514/1017] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:18.958993 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:18.959596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:18.966232 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:18.966678 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:18.967436 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:18.967920 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:19.098467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:19.105972 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-751aa4e7-54db-4124-97be-ebf87d039fac tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.151406 Jun 06 20:54:19.106526 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 504/1018] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:18 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:20.123285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:20.124000 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:20.130716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:20.131154 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:20.131945 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:20.132375 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:20.264019 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:20.271379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b277b17f-2015-4a48-9e5d-62b864c01cf1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.152726 Jun 06 20:54:20.271960 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 515/1019] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:20 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:21.288508 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:21.289125 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:21.295719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:21.296174 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:21.296944 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:21.297383 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:21.423735 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:21.431229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1e09ac95-5d93-4323-ba19-bb94437c1f37 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.147248 Jun 06 20:54:21.438061 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 505/1020] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:21 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:22.448404 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:22.449055 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:22.455472 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:22.455942 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:22.456694 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:22.457156 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:22.584128 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:22.591490 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9ef3a8c1-2fbd-49fe-aeda-45fe6002ab21 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.146921 Jun 06 20:54:22.592076 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 516/1021] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:22 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:54:23.226254 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [req-82ded0d9-352e-4b5b-b8a1-598753dbbf38 req-29910d2a-536f-41ec-9420-214426fabd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de8f42-935f-4a9c-901b-baa02c97cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "720d2265-0788-4ed9-b18f-2ee6dc53026f"}]} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:23.235388 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-82ded0d9-352e-4b5b-b8a1-598753dbbf38 req-29910d2a-536f-41ec-9420-214426fabd65 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:23.235868 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [req-82ded0d9-352e-4b5b-b8a1-598753dbbf38 req-29910d2a-536f-41ec-9420-214426fabd65 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:23.247719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.compute.server_external_events [req-82ded0d9-352e-4b5b-b8a1-598753dbbf38 req-29910d2a-536f-41ec-9420-214426fabd65 service nova] Creating event network-vif-plugged:720d2265-0788-4ed9-b18f-2ee6dc53026f for instance c5de8f42-935f-4a9c-901b-baa02c97cf7d on hv-cinder-84487 Jun 06 20:54:23.252520 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [req-82ded0d9-352e-4b5b-b8a1-598753dbbf38 req-29910d2a-536f-41ec-9420-214426fabd65 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030113 Jun 06 20:54:23.253098 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 506/1022] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:23.608232 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:23.608871 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:23.615571 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:23.616039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:23.616801 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:23.617229 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:23.789774 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:23.797122 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-06fbb50c-2031-47e0-b31d-0b49ba97056c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.192916 Jun 06 20:54:23.797875 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 517/1023] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:23 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:24.811691 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:24.816603 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=6 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:24.817300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:24.818583 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:24.824795 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:24.825244 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:24.826040 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:24.826476 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:24.960184 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:24.967485 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-472c8d31-5581-4548-ad48-9a4c3a168d2a tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1314 microversion: 2.1 time: 0.156877 Jun 06 20:54:24.968074 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 507/1024] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:24 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:25.983976 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:25.984584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:25.986561 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:25.992518 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:25.992983 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:25.993758 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:25.994194 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:26.122123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:26.129481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-ace50583-107a-4245-9f54-af8c05f60564 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1498 microversion: 2.1 time: 0.149358 Jun 06 20:54:26.130058 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 518/1025] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:25 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:26.894267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:26.894877 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:26.901958 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:26.902404 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:26.903163 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:26.903597 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:26.928310 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:54:27.154556 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1bb3486c-8f4b-4781-ae3f-581056aae8fe tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 204 len: 0 microversion: 2.1 time: 0.263715 Jun 06 20:54:27.155100 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 508/1026] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:54:26 2022] DELETE /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:54:27.164935 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:27.165902 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:27.172691 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:27.173176 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:27.173909 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:27.174345 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:27.307648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:27.315088 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-73934a74-9074-4124-a3a9-91d5925882f6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1504 microversion: 2.1 time: 0.155741 Jun 06 20:54:27.315650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 519/1027] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:27 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:28.333069 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:28.333791 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:28.340151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:28.340596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:28.341356 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:28.341785 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:28.472769 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:28.481090 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-3a178ca5-1e1e-445b-861a-a5f09e941610 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1504 microversion: 2.1 time: 0.152220 Jun 06 20:54:28.481587 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 509/1028] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:28 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:28.914077 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-ae943fe9-886b-418b-96b7-a084acf71d8d req-b9aa8493-bcc4-447a-8453-bd089a57c545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de8f42-935f-4a9c-901b-baa02c97cf7d", "name": "network-vif-deleted", "tag": "720d2265-0788-4ed9-b18f-2ee6dc53026f"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:28.922584 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ae943fe9-886b-418b-96b7-a084acf71d8d req-b9aa8493-bcc4-447a-8453-bd089a57c545 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:28.925858 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-ae943fe9-886b-418b-96b7-a084acf71d8d req-b9aa8493-bcc4-447a-8453-bd089a57c545 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:28.934379 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-ae943fe9-886b-418b-96b7-a084acf71d8d req-b9aa8493-bcc4-447a-8453-bd089a57c545 service nova] Creating event network-vif-deleted:720d2265-0788-4ed9-b18f-2ee6dc53026f for instance c5de8f42-935f-4a9c-901b-baa02c97cf7d on hv-cinder-84487 Jun 06 20:54:28.939162 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-ae943fe9-886b-418b-96b7-a084acf71d8d req-b9aa8493-bcc4-447a-8453-bd089a57c545 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029438 Jun 06 20:54:28.939762 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 520/1029] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:29.498389 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:29.498911 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:29.505503 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:29.505946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:29.507272 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:29.507717 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:29.538987 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:29.539433 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:29.539923 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lazy-loading 'fault' on Instance uuid c5de8f42-935f-4a9c-901b-baa02c97cf7d {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:54:29.579530 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:29.587784 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-21e5c5b0-20a0-4446-90d9-29591c809b50 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 200 len: 1304 microversion: 2.1 time: 0.093660 Jun 06 20:54:29.588338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 510/1030] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:29 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:30.605662 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:30.606269 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: c5de8f42-935f-4a9c-901b-baa02c97cf7d] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:30.612585 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:30.613032 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:30.613787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:30.614218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:30.627650 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] HTTP exception thrown: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Request method failure captured: Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d HTTP/1.1 Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmlzAMawS__kUyeGFnesQ5zoToliUHVctheASm2INYRjmeKvHNg0-yQswyaIjy6YU0i6Tz7j3FKVxTM6OzFbMpyeXbL4_HHaQ3raw6eQBkvjMuJFZ0uAJsJINLS6kQEElXlQSFKVhir5UPumKzuYU0WIptwHZ7Gc7Oj-cMibJkKLLsU Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 615b738dad2c43d8a7cef6086bb467de Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:54:30.629239 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_615b738dad2c43d8a7cef6086bb467de", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 615b738dad2c43d8a7cef6086bb467de Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesActionsTest-1113360782-project Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: ea091ae58b114083abd29801f6d8baff Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesActionsTest-1113360782-project Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. Jun 06 20:54:30.631075 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'c5de8f42-935f-4a9c-901b-baa02c97cf7d'} Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:54:30.632361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. Jun 06 20:54:30.634134 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:30.636542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Returning 404 to user: Instance c5de8f42-935f-4a9c-901b-baa02c97cf7d could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:54:30.636542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d9df3612-3649-4dae-83e0-35a795e48c1c tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d" status: 404 len: 111 microversion: 2.1 time: 0.030291 Jun 06 20:54:30.636542 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 521/1031] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:30 2022] GET /compute/v2.1/servers/c5de8f42-935f-4a9c-901b-baa02c97cf7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:54:30.702566 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1558921506", "imageRef": "00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1", "flavorRef": "452", "networks": [{"uuid": "13b69029-da1f-430c-b77e-8c726d2efcc5"}]}} {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:30.752696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.network.neutron [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] validate_networks() for [('13b69029-da1f-430c-b77e-8c726d2efcc5', None, None, None, None, None)] {{(pid=124578) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 20:54:31.085059 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Flavor limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 20:54:31.085488 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Image limits 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 20:54:31.085965 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Flavor pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 20:54:31.086374 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Image pref 0:0:0 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 20:54:31.086789 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.virt.hardware [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124578) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 20:54:31.095483 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:31.095959 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:31.096754 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:31.097187 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:31.113777 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Getting quotas for project 615b738dad2c43d8a7cef6086bb467de. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 20:54:31.117607 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.quota [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Getting quotas for user ea091ae58b114083abd29801f6d8baff and project 615b738dad2c43d8a7cef6086bb467de. Resources: {'instances', 'cores', 'ram'} {{(pid=124578) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 20:54:31.128229 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Going to run 1 instances... {{(pid=124578) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 20:54:31.130416 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00a8783c-95a9-48f3-a5dd-3fd0aa3a3ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124578) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 20:54:31.229472 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-90001ed0-e963-4eee-a816-b7b45166c593 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530636 Jun 06 20:54:31.230330 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 511/1032] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 20:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 20:54:31.240123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-8de9572d-6e29-4697-8832-913ccf997afd tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:31.240733 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-8de9572d-6e29-4697-8832-913ccf997afd tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:31.293497 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-8de9572d-6e29-4697-8832-913ccf997afd tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:31.300178 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-8de9572d-6e29-4697-8832-913ccf997afd tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1214 microversion: 2.1 time: 0.064208 Jun 06 20:54:31.300726 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 522/1033] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:31 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:32.317088 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:32.317696 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:32.324501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:32.324939 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:32.325708 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:32.326133 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:32.387871 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:32.395362 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4844dcdc-0c99-4a6f-bc4a-fbe230d87b7f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1210 microversion: 2.1 time: 0.082867 Jun 06 20:54:32.395946 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 512/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:32 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:33.413280 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:33.414026 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:33.421684 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:33.422123 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:33.422882 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:33.423315 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:33.492262 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:33.499772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-9b79ff62-dea5-4a1d-905e-46723115be0f tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1272 microversion: 2.1 time: 0.090888 Jun 06 20:54:33.500338 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 523/1035] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:33 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:34.516610 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:34.517216 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:34.524305 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:34.524745 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:34.525498 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:34.525927 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:34.613161 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-be95e8e5-f21b-4499-95ae-ca765c8e815b req-d9dd6e14-275d-49af-9c30-20415143c643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2", "tag": "7e938b9a-45d5-4142-9c4f-e1cbe3238e1e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:34.619064 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-be95e8e5-f21b-4499-95ae-ca765c8e815b req-d9dd6e14-275d-49af-9c30-20415143c643 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:34.619506 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-be95e8e5-f21b-4499-95ae-ca765c8e815b req-d9dd6e14-275d-49af-9c30-20415143c643 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:34.632083 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-be95e8e5-f21b-4499-95ae-ca765c8e815b req-d9dd6e14-275d-49af-9c30-20415143c643 service nova] Creating event network-changed:7e938b9a-45d5-4142-9c4f-e1cbe3238e1e for instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 on hv-cinder-84487 Jun 06 20:54:34.637310 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-be95e8e5-f21b-4499-95ae-ca765c8e815b req-d9dd6e14-275d-49af-9c30-20415143c643 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035595 Jun 06 20:54:34.637905 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 524/1036] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:34.666338 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:34.672605 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-47c8858c-dffa-48ac-9a49-90357041a9ae tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.159796 Jun 06 20:54:34.673261 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 513/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:34 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:35.690860 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:35.691466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:35.697743 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:35.698191 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:35.698951 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:35.699384 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:35.825874 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:35.833273 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-e7b38b8c-7e5f-45ab-9a37-12c70101fde3 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.147123 Jun 06 20:54:35.833824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 525/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:35 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:36.850635 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:36.851186 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:36.857853 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:36.858301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:36.859053 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:36.859485 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:36.983896 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:36.991408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-441f0b06-37fc-4634-945a-34fb8455b4d7 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.145325 Jun 06 20:54:36.992008 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 514/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:36 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:38.007957 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:38.008563 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:38.015344 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:38.015818 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:38.016568 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:38.016995 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:38.144601 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:38.152486 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-d34ef8d9-8d26-4807-bf3f-bb14be85c3c6 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.148384 Jun 06 20:54:38.153035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 526/1040] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:38 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:39.168706 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:39.172806 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:39.175895 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:39.176336 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:39.177087 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:39.177514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:39.315182 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:39.315455 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-11f44f53-1fdf-467f-bde6-8a02a5d7b58d req-2478448e-1334-479e-a8f0-fbed560ca7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2", "name": "network-vif-plugged", "status": "completed", "tag": "7e938b9a-45d5-4142-9c4f-e1cbe3238e1e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:39.320650 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-43664086-360c-4328-b22c-cf98a71b6a48 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.155759 Jun 06 20:54:39.321501 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 515/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:39 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:39.324492 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-11f44f53-1fdf-467f-bde6-8a02a5d7b58d req-2478448e-1334-479e-a8f0-fbed560ca7d1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:39.324932 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-11f44f53-1fdf-467f-bde6-8a02a5d7b58d req-2478448e-1334-479e-a8f0-fbed560ca7d1 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:39.335947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-11f44f53-1fdf-467f-bde6-8a02a5d7b58d req-2478448e-1334-479e-a8f0-fbed560ca7d1 service nova] Creating event network-vif-plugged:7e938b9a-45d5-4142-9c4f-e1cbe3238e1e for instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 on hv-cinder-84487 Jun 06 20:54:39.340824 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-11f44f53-1fdf-467f-bde6-8a02a5d7b58d req-2478448e-1334-479e-a8f0-fbed560ca7d1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029122 Jun 06 20:54:39.341553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 527/1042] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:54:40.338209 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:40.338809 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:40.345299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:40.345746 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:40.348235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:40.348235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:40.474655 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:40.482265 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-657080c8-7a68-423d-a945-ca9ea6f6e9a0 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1314 microversion: 2.1 time: 0.148447 Jun 06 20:54:40.482767 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 516/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:40 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:41.497160 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell0:SELECT=2 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:41.501285 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:41.502001 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:41.508682 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:41.509119 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:41.510168 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:41.510595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:41.640040 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:41.647411 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-0fa26f7a-350c-47a5-a28e-e0ef74c2a5bf tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1499 microversion: 2.1 time: 0.151715 Jun 06 20:54:41.649110 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 528/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:41 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:42.358970 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:42.359527 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:42.361468 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:42.362133 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell0:SELECT=6 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:42.368151 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:42.368625 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:42.369467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:42.369907 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:42.387757 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:42.394765 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:54:42.652888 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-c144392d-19b3-4c1c-bf45-dbea94e93a1e tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 204 len: 0 microversion: 2.1 time: 0.298346 Jun 06 20:54:42.653548 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 517/1045] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:54:42 2022] DELETE /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:54:42.661837 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:42.662441 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:42.669576 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:42.675716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:42.675716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:42.675716 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:42.801588 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:42.809049 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-dd9a9d3a-971b-4005-bf2a-5d6769779b65 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1505 microversion: 2.1 time: 0.151286 Jun 06 20:54:42.809595 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 529/1046] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:42 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:43.827971 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:43.828680 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:43.831119 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:43.836250 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:43.836693 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:43.837515 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:43.838002 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:43.971381 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:43.978928 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-33cae174-9383-48ee-a84c-5f945cfcf442 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1505 microversion: 2.1 time: 0.155585 Jun 06 20:54:43.980035 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 518/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:43 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:44.538551 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-44330bca-1604-4fcf-abec-6ef32b68b3fc req-d6fceeea-aaa0-4236-875d-7dba139c723b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2", "name": "network-vif-deleted", "tag": "7e938b9a-45d5-4142-9c4f-e1cbe3238e1e"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:54:44.547101 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-44330bca-1604-4fcf-abec-6ef32b68b3fc req-d6fceeea-aaa0-4236-875d-7dba139c723b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:44.549127 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-44330bca-1604-4fcf-abec-6ef32b68b3fc req-d6fceeea-aaa0-4236-875d-7dba139c723b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:44.558596 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-44330bca-1604-4fcf-abec-6ef32b68b3fc req-d6fceeea-aaa0-4236-875d-7dba139c723b service nova] Creating event network-vif-deleted:7e938b9a-45d5-4142-9c4f-e1cbe3238e1e for instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 on hv-cinder-84487 Jun 06 20:54:44.563361 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-44330bca-1604-4fcf-abec-6ef32b68b3fc req-d6fceeea-aaa0-4236-875d-7dba139c723b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028596 Jun 06 20:54:44.566414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 530/1048] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:54:44.998587 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:44.999228 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:45.005786 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:45.006235 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:45.007000 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:45.007439 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:45.040431 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:45.040880 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:45.041328 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.objects.instance [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lazy-loading 'fault' on Instance uuid 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 {{(pid=124578) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 20:54:45.081573 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea091ae58b114083abd29801f6d8baff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615b738dad2c43d8a7cef6086bb467de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:54:45.089908 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9b1fcc8c-c3ff-45dd-9db1-080e5f141bb1 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 200 len: 1304 microversion: 2.1 time: 0.096082 Jun 06 20:54:45.090475 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 519/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:44 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:54:46.108090 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:54:46.108787 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] [instance: 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:54:46.114950 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:46.115392 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:46.116177 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:54:46.116613 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:54:46.129519 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] HTTP exception thrown: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Request method failure captured: Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 HTTP/1.1 Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmlzAMawS__kUyeGFnesQ5zoToliUHVctheASm2INYRjmeKvHNg0-yQswyaIjy6YU0i6Tz7j3FKVxTM6OzFbMpyeXbL4_HHaQ3raw6eQBkvjMuJFZ0uAJsJINLS6kQEElXlQSFKVhir5UPumKzuYU0WIptwHZ7Gc7Oj-cMibJkKLLsU Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: 615b738dad2c43d8a7cef6086bb467de Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:54:46.131087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/615b738dad2c43d8a7cef6086bb467de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_615b738dad2c43d8a7cef6086bb467de", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: 615b738dad2c43d8a7cef6086bb467de Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-VolumesActionsTest-1113360782 Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-VolumesActionsTest-1113360782-project Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: ea091ae58b114083abd29801f6d8baff Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-VolumesActionsTest-1113360782-project Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. Jun 06 20:54:46.132749 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2'} Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:54:46.133598 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. Jun 06 20:54:46.135431 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:54:46.137520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] Returning 404 to user: Instance 2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:54:46.137520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-91cfe088-830a-4433-8f5e-2371f7b93944 tempest-VolumesActionsTest-1113360782 tempest-VolumesActionsTest-1113360782-project] 10.222.0.41 "GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2" status: 404 len: 111 microversion: 2.1 time: 0.029455 Jun 06 20:54:46.137520 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 531/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:54:46 2022] GET /compute/v2.1/servers/2ecdbcad-aa2b-4bca-be7a-39e0ffa36fb2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:55:26.399712 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:26.400268 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:26.402334 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_api:SELECT=5 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:26.402470 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-7b533422-3dca-456f-86e1-de2072db2c1d req-15e3b943-5734-4298-9786-494fc1604a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60146555-8874-4e5f-b32c-203764e98af2", "tag": "26cf061b-b4d3-4ad4-8e9f-eec0d8e205df"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:55:26.403286 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG dbcounter [-] [124578] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:26.408719 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:26.416034 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_api:SELECT=44 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:26.416226 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:26.416335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG dbcounter [-] [124579] Writing DB stats nova_cell1:SELECT=80 {{(pid=124579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:26.416448 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:26.416448 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:26.416648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-7b533422-3dca-456f-86e1-de2072db2c1d req-15e3b943-5734-4298-9786-494fc1604a88 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:26.416648 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-7b533422-3dca-456f-86e1-de2072db2c1d req-15e3b943-5734-4298-9786-494fc1604a88 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:26.428092 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-7b533422-3dca-456f-86e1-de2072db2c1d req-15e3b943-5734-4298-9786-494fc1604a88 service nova] Creating event network-changed:26cf061b-b4d3-4ad4-8e9f-eec0d8e205df for instance 60146555-8874-4e5f-b32c-203764e98af2 on hv-cinder-84487 Jun 06 20:55:26.434312 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-7b533422-3dca-456f-86e1-de2072db2c1d req-15e3b943-5734-4298-9786-494fc1604a88 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036724 Jun 06 20:55:26.435867 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 532/1051] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:55:26.438513 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:55:26.771633 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-18f2ddf7-928e-48b7-968a-288ab0078495 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 204 len: 0 microversion: 2.1 time: 0.376015 Jun 06 20:55:26.772342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 520/1052] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:55:26 2022] DELETE /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:55:26.781896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:26.782833 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:26.791348 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:26.791959 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:26.792777 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:26.793218 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:26.932895 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:26.941087 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-b4f20a2f-4106-4992-ab58-267c6e7623e4 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1578 microversion: 2.1 time: 0.163869 Jun 06 20:55:26.941687 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 533/1053] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:26 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:27.959823 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:27.960514 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:27.967280 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:27.967752 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:27.968504 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:27.969001 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:28.103756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:28.111396 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a319c3e2-34d5-4c65-af2a-b5cee44f80dd tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1459 microversion: 2.1 time: 0.156198 Jun 06 20:55:28.112084 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 521/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:27 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:28.789660 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-f0f4f1bf-22f6-47bc-b7f1-ed45f445d369 req-cea5e74e-0a8c-4a80-9c1b-ed6abcce2e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60146555-8874-4e5f-b32c-203764e98af2", "name": "network-vif-deleted", "tag": "26cf061b-b4d3-4ad4-8e9f-eec0d8e205df"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:55:28.798045 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-f0f4f1bf-22f6-47bc-b7f1-ed45f445d369 req-cea5e74e-0a8c-4a80-9c1b-ed6abcce2e04 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:28.798492 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-f0f4f1bf-22f6-47bc-b7f1-ed45f445d369 req-cea5e74e-0a8c-4a80-9c1b-ed6abcce2e04 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:28.809363 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-f0f4f1bf-22f6-47bc-b7f1-ed45f445d369 req-cea5e74e-0a8c-4a80-9c1b-ed6abcce2e04 service nova] Creating event network-vif-deleted:26cf061b-b4d3-4ad4-8e9f-eec0d8e205df for instance 60146555-8874-4e5f-b32c-203764e98af2 on hv-cinder-84487 Jun 06 20:55:28.814040 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-f0f4f1bf-22f6-47bc-b7f1-ed45f445d369 req-cea5e74e-0a8c-4a80-9c1b-ed6abcce2e04 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028044 Jun 06 20:55:28.814619 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 534/1055] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:55:29.128964 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:29.129583 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:29.136648 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:29.137342 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:29.138127 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:29.138570 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:29.206840 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:29.212582 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-a729c58a-ead9-4140-bbcc-ecb4e7c59b2a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 200 len: 1225 microversion: 2.1 time: 0.088454 Jun 06 20:55:29.213172 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 522/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:29 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:30.232517 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:30.233219 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 60146555-8874-4e5f-b32c-203764e98af2] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:30.240287 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:30.240738 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:30.241511 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:30.241947 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:30.256060 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] HTTP exception thrown: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Request method failure captured: Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 HTTP/1.1 Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgWYa1J--8G6UrFYkTGYfqUoqHDuWHwQA_A59Q1ZQFpyntAiF6coc16dgON5yKP0pLEnX_fxNCw-J-VRE1Npeh4NKGSvT-ExpUkmL57tJfv8Py-OUoCURoogqBMImkxKG-aViclyL4mVAA96JTp4z9byl1Jd6pEZTAFw1wA_ruoAqA Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:55:30.257681 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c1ea53cfd795419cacebe7f2d071f37f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 2bb3e3fc9a494cdf8abd264038af044c Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. Jun 06 20:55:30.259717 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '60146555-8874-4e5f-b32c-203764e98af2'} Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:55:30.260659 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. Jun 06 20:55:30.262388 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:30.264063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Returning 404 to user: Instance 60146555-8874-4e5f-b32c-203764e98af2 could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:55:30.264063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-03a0f1f8-328f-4249-80bf-02bdde258b58 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2" status: 404 len: 111 microversion: 2.1 time: 0.031684 Jun 06 20:55:30.264063 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 535/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:30 2022] GET /compute/v2.1/servers/60146555-8874-4e5f-b32c-203764e98af2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:55:33.598596 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:33.599123 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:33.601418 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-9aed5f61-ab43-423d-b2a2-c7b03184ef7e req-49e28719-04ad-4798-aa97-f5a640e81d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccb3806-679a-4d48-8e91-9dc2037a15dd", "tag": "a2362686-dc53-476f-8337-3b482cdeed2a"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:55:33.606755 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:33.607299 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:33.608421 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:33.609086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:33.610967 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-9aed5f61-ab43-423d-b2a2-c7b03184ef7e req-49e28719-04ad-4798-aa97-f5a640e81d8b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:33.611419 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-9aed5f61-ab43-423d-b2a2-c7b03184ef7e req-49e28719-04ad-4798-aa97-f5a640e81d8b service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:33.625039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-9aed5f61-ab43-423d-b2a2-c7b03184ef7e req-49e28719-04ad-4798-aa97-f5a640e81d8b service nova] Creating event network-changed:a2362686-dc53-476f-8337-3b482cdeed2a for instance fccb3806-679a-4d48-8e91-9dc2037a15dd on hv-cinder-84487 Jun 06 20:55:33.632293 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-9aed5f61-ab43-423d-b2a2-c7b03184ef7e req-49e28719-04ad-4798-aa97-f5a640e81d8b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035609 Jun 06 20:55:33.633193 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 536/1058] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:55:33.642996 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Going to try to terminate instance {{(pid=124578) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 20:55:33.914384 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-9e432616-3e4d-4a3e-b0d9-af2b6ead173a tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 204 len: 0 microversion: 2.1 time: 0.319960 Jun 06 20:55:33.918241 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 523/1059] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:55:33 2022] DELETE /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 20:55:33.924250 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:33.924936 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:33.932335 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:33.932853 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:33.933857 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:33.934496 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:34.078038 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.policy [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124579) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:34.086129 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-246bfe0c-28db-446d-86fc-db13d722be20 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1578 microversion: 2.1 time: 0.166388 Jun 06 20:55:34.086696 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 537/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:33 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:35.103555 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:35.104207 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:35.112301 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:35.116733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:35.116733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:35.116733 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:35.253867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:35.261692 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-651402d2-2f91-482c-b822-5f00cf555bad tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1578 microversion: 2.1 time: 0.162539 Jun 06 20:55:35.262270 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 524/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:35 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:35.998775 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [req-8904cedd-2977-4caf-b990-2cffa6909d77 req-18e70337-227b-460a-ba76-3ca89e85a8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb3806-679a-4d48-8e91-9dc2037a15dd", "name": "network-vif-deleted", "tag": "a2362686-dc53-476f-8337-3b482cdeed2a"}]} {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:55:36.009487 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-8904cedd-2977-4caf-b990-2cffa6909d77 req-18e70337-227b-460a-ba76-3ca89e85a8c8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:36.009924 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [req-8904cedd-2977-4caf-b990-2cffa6909d77 req-18e70337-227b-460a-ba76-3ca89e85a8c8 service nova] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:36.020843 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.compute.server_external_events [req-8904cedd-2977-4caf-b990-2cffa6909d77 req-18e70337-227b-460a-ba76-3ca89e85a8c8 service nova] Creating event network-vif-deleted:a2362686-dc53-476f-8337-3b482cdeed2a for instance fccb3806-679a-4d48-8e91-9dc2037a15dd on hv-cinder-84487 Jun 06 20:55:36.025640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [req-8904cedd-2977-4caf-b990-2cffa6909d77 req-18e70337-227b-460a-ba76-3ca89e85a8c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030935 Jun 06 20:55:36.026453 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 538/1062] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:55:36.280289 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:36.281023 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:36.288856 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:36.289756 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:36.290346 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:36.290785 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:36.367740 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.policy [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb3e3fc9a494cdf8abd264038af044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea53cfd795419cacebe7f2d071f37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124578) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 20:55:36.378134 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-1109a59f-1649-4eee-978d-b10593485a0b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 200 len: 1226 microversion: 2.1 time: 0.101686 Jun 06 20:55:36.378788 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 525/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:36 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:55:37.396618 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:37.398275 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: fccb3806-679a-4d48-8e91-9dc2037a15dd] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:37.405772 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.406256 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:37.407035 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.407466 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:37.421414 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] HTTP exception thrown: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Request method failure captured: Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd HTTP/1.1 Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgWYa1J--8G6UrFYkTGYfqUoqHDuWHwQA_A59Q1ZQFpyntAiF6coc16dgON5yKP0pLEnX_fxNCw-J-VRE1Npeh4NKGSvT-ExpUkmL57tJfv8Py-OUoCURoogqBMImkxKG-aViclyL4mVAA96JTp4z9byl1Jd6pEZTAFw1wA_ruoAqA Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:55:37.423023 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c1ea53cfd795419cacebe7f2d071f37f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 2bb3e3fc9a494cdf8abd264038af044c Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. Jun 06 20:55:37.424707 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': 'fccb3806-679a-4d48-8e91-9dc2037a15dd'} Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:55:37.426226 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. Jun 06 20:55:37.427896 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.429342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Returning 404 to user: Instance fccb3806-679a-4d48-8e91-9dc2037a15dd could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:55:37.429342 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-5e81797a-64b9-4857-b02e-55702076e3ab tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd" status: 404 len: 111 microversion: 2.1 time: 0.032815 Jun 06 20:55:37.429955 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 539/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:37 2022] GET /compute/v2.1/servers/fccb3806-679a-4d48-8e91-9dc2037a15dd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:55:37.947832 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:37.948408 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.compute.api [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124578) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:37.954614 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.955064 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:37.955867 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.956300 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG oslo_concurrency.lockutils [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:37.970078 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.wsgi [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] HTTP exception thrown: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Request method failure captured: Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: request: DELETE /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb HTTP/1.1 Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept: application/json Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Accept-Encoding: identity Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Connection: close Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Length: 0 Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Content-Type: application/json Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Host: 10.222.0.41 Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Openstack-System-Scope: None Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: User-Agent: python-urllib3/1.26.9 Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Auth-Token: gAAAAABinmgWYa1J--8G6UrFYkTGYfqUoqHDuWHwQA_A59Q1ZQFpyntAiF6coc16dgON5yKP0pLEnX_fxNCw-J-VRE1Npeh4NKGSvT-ExpUkmL57tJfv8Py-OUoCURoogqBMImkxKG-aViclyL4mVAA96JTp4z9byl1Jd6pEZTAFw1wA_ruoAqA Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Id: None Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Domain-Name: None Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Identity-Status: Confirmed Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Is-Admin-Project: True Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Id: default Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Domain-Name: Default Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Project-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Role: reader,member Jun 06 20:55:37.972565 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Roles: reader,member Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c1ea53cfd795419cacebe7f2d071f37f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-Tenant-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Id: default Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Domain-Name: Default Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Id: 2bb3e3fc9a494cdf8abd264038af044c Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: X-User-Name: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: method: > Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: exception: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:37.974267 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: action_args: {'id': '3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb'} Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:55:37.975212 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:37.977099 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR nova.api.openstack.wsgi Jun 06 20:55:37.978753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Returning 404 to user: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. {{(pid=124578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:55:37.978753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-4be7883d-1b3f-4606-a836-4abd5d2db957 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 404 len: 111 microversion: 2.1 time: 0.029964 Jun 06 20:55:37.978753 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 526/1065] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 20:55:37 2022] DELETE /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:55:37.985920 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '>' {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:37.986534 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.compute.api [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [instance: 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb] Fetching instance by UUID {{(pid=124579) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 20:55:37.993377 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.993828 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:37.994600 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:37.995039 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG oslo_concurrency.lockutils [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Lock "6d772098-9589-43ac-94cf-689c77728b5a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:38.009228 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.wsgi [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] HTTP exception thrown: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Request method failure captured: Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: request: GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb HTTP/1.1 Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept: application/json Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Accept-Encoding: identity Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Connection: close Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Length: 0 Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Content-Type: application/json Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Host: 10.222.0.41 Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Openstack-System-Scope: None Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: User-Agent: python-urllib3/1.26.9 Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Auth-Token: gAAAAABinmgWYa1J--8G6UrFYkTGYfqUoqHDuWHwQA_A59Q1ZQFpyntAiF6coc16dgON5yKP0pLEnX_fxNCw-J-VRE1Npeh4NKGSvT-ExpUkmL57tJfv8Py-OUoCURoogqBMImkxKG-aViclyL4mVAA96JTp4z9byl1Jd6pEZTAFw1wA_ruoAqA Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Id: None Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Domain-Name: None Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Identity-Status: Confirmed Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Is-Admin-Project: True Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Id: default Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Domain-Name: Default Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Project-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Role: reader,member Jun 06 20:55:38.010742 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Roles: reader,member Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c1ea53cfd795419cacebe7f2d071f37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c1ea53cfd795419cacebe7f2d071f37f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Id: c1ea53cfd795419cacebe7f2d071f37f Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-Tenant-Name: tempest-TestVolumeBootPattern-20911414 Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Id: default Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Domain-Name: Default Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Id: 2bb3e3fc9a494cdf8abd264038af044c Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: X-User-Name: tempest-TestVolumeBootPattern-20911414-project Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: method: > Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: exception: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:38.012481 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: action_args: {'id': '3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb'} Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: {{(pid=124579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:55:38.013308 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. Jun 06 20:55:38.014808 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: ERROR nova.api.openstack.wsgi Jun 06 20:55:38.016302 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: DEBUG nova.api.openstack.wsgi [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Returning 404 to user: Instance 3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb could not be found. {{(pid=124579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:55:38.016302 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO nova.api.openstack.requestlog [None req-3001565c-0c6a-407e-b5b7-3213324e32b8 tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb" status: 404 len: 111 microversion: 2.1 time: 0.030056 Jun 06 20:55:38.016302 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: [pid: 124579|app: 0|req: 540/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 20:55:37 2022] GET /compute/v2.1/servers/3bdbc33d-06de-4a5b-8b8a-fcf36fdce2bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 20:55:39.525437 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: DEBUG nova.api.openstack.wsgi [None req-449645ba-b87e-4231-9a26-986970c5be9b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] Calling method '.version_select at 0x7fdaea5bea60>' {{(pid=124578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:39.529507 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: ERROR oslo.messaging._drivers.impl_rabbit [None req-449645ba-b87e-4231-9a26-986970c5be9b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [81d9995d-fb88-4050-8014-af802ccca5e0] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 06 20:55:40.536432 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [None req-449645ba-b87e-4231-9a26-986970c5be9b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] [81d9995d-fb88-4050-8014-af802ccca5e0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 49358. Jun 06 20:55:40.595124 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO nova.api.openstack.requestlog [None req-449645ba-b87e-4231-9a26-986970c5be9b tempest-TestVolumeBootPattern-20911414 tempest-TestVolumeBootPattern-20911414-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1910891760" status: 202 len: 0 microversion: 2.1 time: 1.074233 Jun 06 20:55:40.595636 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: [pid: 124578|app: 0|req: 527/1067] 10.222.0.41 () {58 vars in 1262 bytes} [Mon Jun 6 20:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1910891760 => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 20:57:28.940467 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:57:28.941085 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 20:57:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 20:57:40.387803 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:57:40.388477 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 20:57:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 20:58:50.179553 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:58:50.180202 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Mon Jun 6 20:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 20:59:08.615900 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 20:59:08.616640 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Mon Jun 6 20:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:00:42.910185 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:00:42.910730 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 21:00:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:00:46.689709 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:00:46.690264 dv-cinder-844879-1-iscsi devstack@n-api.service[124579]: Mon Jun 6 21:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:00:48.949455 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:00:48.950086 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 21:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:01:00.395705 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:01:00.396365 dv-cinder-844879-1-iscsi devstack@n-api.service[124578]: Mon Jun 6 21:01:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!